To develop and manage Hologres tasks in DataWorks, associate your Hologres instance as a Hologres computing resource. Once associated, DataWorks uses the resource to connect to your Hologres instance for data synchronization, data development, and data analysis.
Prerequisites
Before you begin, ensure that you have:
A Hologres instance and a database. See Purchase a Hologres instance and Create a database
ImportantThe Hologres instance must be in the same region as your DataWorks workspace. Confirm that the instance's Running Status is Normal before proceeding.
A DataWorks workspace. The account performing this operation must be a workspace member with the Workspace Administrator role
A resource group associated with the workspace, with network connectivity established:
Serverless resource group: Confirm that the Hologres computing resource can reach the Serverless resource group
Legacy exclusive resource group: Confirm connectivity to the exclusive resource group for integration, exclusive resource group for scheduling, and exclusive service resource group, depending on your scenario. See Use legacy resource groups
Limits
Feature: If you enable SSL authentication on the computing resource, the resource cannot be used for data development or periodic scheduling tasks.
Regions: China (Hangzhou), China (Shanghai), China (Beijing), China (Shenzhen), Japan (Tokyo), Malaysia (Kuala Lumpur), and Indonesia (Jakarta).
Permissions:
| Operator | Required permissions |
|---|---|
| Alibaba Cloud account | No additional permissions required |
| RAM user or RAM role | DataWorks: O&M or Workspace Administrator role, or the AliyunDataWorksFullAccess permission. See Grant the Workspace Administrator permission to a user. Hologres: Grant the AliyunHologresFullAccess access policy, and add the account or role to User Management. Both are required; without them, the computing resource cannot be configured and the destination database cannot be selected. |
Associate a Hologres computing resource (Data Studio)
Follow these steps if your workspace uses Use Data Studio (New Version).
The process has four steps: go to the Computing Resource page, select the Hologres resource type, configure parameters, and test connectivity.
Go to the Computing Resource page
Log on to the DataWorks console and switch to the target region. In the left navigation pane, click More > Management Center. Select the target workspace from the drop-down list and click Go To Management Center.
In the left navigation pane, click Computing Resource.
Configure and associate the Hologres computing resource
On the Computing Resource page, click Associate Computing Resource.
On the Associate Computing Resource page, set the computing resource type to Hologres to open the configuration page.
Configure the parameters.
NoteWhich access identities you can select depends on your login account:
Alibaba Cloud account: All identities are available.
RAM user or RAM role with `AdministratorAccess`: All identities are available.
RAM user or RAM role without `AdministratorAccess`: Only your own identity is available.
Parameter Description Hologres instance Select the Hologres instance to associate. Click Create in the drop-down list to purchase a new instance. Hologres compute group Select the compute group for the instance. Click Create to create a compute group. Database name Select the database to use. Click Create to create a database. Default access identity Development environment: Only Executor is supported. Production environment: Supported identities are Alibaba Cloud Account, Alibaba Cloud RAM User, Alibaba Cloud RAM Role, and Task Owner. Which identities you can select depends on your account type — see the note below. Authentication method No Authentication: No further configuration needed. SSL Authentication: Enable SSL Encryption on the Data Security page of your Hologres instance before selecting this option. Limitation: SSL authentication disables data development and periodic scheduling for this resource. SSL encryption Appears when Authentication method is set to SSL Authentication. Only the require encryption mode is supported. Computing resource instance name Enter a custom name. This name identifies the computing resource when you assign it to a task. In the connection configuration section, select the resource group that DataWorks uses to run Hologres tasks and click Test Network Connectivity. For details on connectivity options, see Overview of network connection solutions.
Click OK.
After the computing resource is associated, DataWorks automatically creates a Hologres data source with the same name in the Data Sources list for the current workspace.
Associate a Hologres computing resource (Legacy Data Studio)
Follow these steps if your workspace does not use Use Data Studio (New Version).
The process has four steps: go to the Computing Resource page, select the Hologres resource type, configure parameters, and test connectivity.
Go to the Computing Resource page
Log on to the DataWorks console. In the top navigation bar, select the target region. In the left navigation pane, choose Data Development and O&M > Data Development. Select the target workspace from the drop-down list and click Go to Data Development.
In the left navigation pane, click the
icon to open the Computing Resource page.
Configure and associate the Hologres computing resource
On the Computing Resource page, click Create Computing Resource.
On the Create Computing Resource page, set the computing resource type to Hologres to open the configuration page.
Configure the parameters.
NoteWhich access identities you can select depends on your login account:
Alibaba Cloud account: All identities are available.
RAM user or RAM role with `AdministratorAccess`: All identities are available.
RAM user or RAM role without `AdministratorAccess`: Only your own identity is available.
Parameter Description Data source name Enter a custom name for the computing resource. Authentication method Only Alibaba Cloud Account And Alibaba Cloud RAM Role is supported. Alibaba Cloud account Select Current Alibaba Cloud Account or Other Alibaba Cloud Account. If you select Other Alibaba Cloud Account, enter the account information as prompted. Region The region where your workspace resides. Hologres instance Select the Hologres instance to associate. Database name Select the database to use. Default access identity Development environment: Only Executor is supported. Production environment: Supported identities are Alibaba Cloud Account, Alibaba Cloud RAM User, Alibaba Cloud RAM Role, and Task Owner. Which identities you can select depends on your account type — see the note below. Authentication method No Authentication: No further configuration needed. SSL Authentication: Enable SSL Encryption on the Data Security page of your Hologres instance before selecting this option. Limitation: SSL authentication disables data development and periodic scheduling for this resource. SSL encryption Appears when Authentication method is set to SSL Authentication. Only the require encryption mode is supported. In the connection configuration section, select the resource group that DataWorks uses to run Hologres tasks and click Test Network Connectivity. For details, see Overview of network connection solutions.
Click Create and Associate Computing Resource with DataStudio.
After the computing resource is associated, DataWorks automatically creates a Hologres data source with the same name in the Data Sources list for the current workspace.
What's next
Read Instructions for using DataWorks on Hologres to understand the development process, fees, environment preparation, and access control before building your first pipeline.
Data Studio: Use a batch synchronization node for data synchronization and Hologres nodes for data development.
Legacy Data Studio: Use Data Integration > Offline Synchronization for data synchronization and legacy Hologres nodes for data development.
FAQ
Connection refused: `FAILED: Build connection error! Connection to xxx.hologres.aliyuncs.com:80 refused.`
The Hologres instance is likely shut down. Open the Hologres console, check the instance status, and restart it if needed.
I/O error: `FAILED: An I/O error occurred while sending to the backend.`
On the Data Security page of the Hologres instance, check whether the SSL Encryption switch is turned on. If it is turned on, turn it off and wait 5 to 10 seconds before you run the task again.