DataWorks:Connect to a self-managed data source on an ECS instance

Same account and region

Deploy the DataWorks resource group and ECS instance in the same VPC to establish network communication over a private connection.

Same account, different regions

Use CEN or a VPC Peering Connection to link the VPC of the DataWorks resource group with the VPC of the ECS instance across regions.

Different accounts

Use CEN or a VPC Peering Connection to link the VPC of the DataWorks resource group with the VPC of the ECS instance across accounts.

Step 1: Get the required information

Collect the VPC and vSwitch details for both the ECS instance and the DataWorks resource group. The information you need depends on your scenario.

Step 2: Establish a network connection

Step 3: Add a route to the resource group

This step is required only for cross-region or cross-account scenarios. Skip this step if the ECS instance and the DataWorks workspace are in the same account and region.

Add a route in the DataWorks resource group that points to the CIDR block of the ECS instance's vSwitch.

1. Go to the DataWorks resource group list. Find the target resource group and click Network Settings in the Actions column.

2. Under the relevant feature module, find the associated VPC and click Custom Route in the Actions column.

3. Click Add Route. Set the connection method to CIDR Block and set Destination CIDR Block to the CIDR block of the ECS instance's vSwitch.

After saving, the route entry appears in the custom route list for the associated VPC.

Step 4: (Optional) Enable remote database access

Some databases require you to configure the database to accept connections from external IP addresses. The exact steps vary by database — refer to your database's official documentation.

For MySQL-specific instructions, see step 4 in the configuration example.

Step 5: Configure the security group

ECS security groups act as firewalls. Add an inbound rule to the security group of the ECS instance to open the database port to the CIDR block of the DataWorks resource group's vSwitch.

1. Go to the Elastic Compute Service console. In the top navigation bar, select the region where your ECS instance is located.

2. In the left-side navigation pane, choose Instances. Find the ECS instance that hosts your database and click the instance name to open the Instance Details page.

3. Click the Security Groups tab, then click the name of the security group to open the Security Group Details page.

4. In the Rules section, click Add Rule and configure the following parameters. Keep the default values for all other parameters.

   Parameter	Value
   Source	The CIDR block of the DataWorks resource group's vSwitch
   Port Range	The port used by your database (see the table below)

Common database ports:

1. Basic information

2. Establish network connection

This example uses a VPC Peering Connection to connect the ECS instance to DataWorks.

If you encounter issues while establishing the connection, submit a ticket to contact technical support for the relevant cloud product.

1. Log on to Account A. Go to the VPC Peering Connection console. In the top navigation bar, select the China (Hangzhou) region, then click Create Peering Connection. Configure the following key parameters. Keep the default values for all other parameters.

   Parameter	Configuration
   Peering connection name	Enter a custom name. This example uses Account_A to Account_B.
   Requester VPC instance	The VPC in Account A that contains the ECS instance. This example uses Account_A_hangzhou_VPC.
   Accepter account type	Select Cross-account.
   Accepter Alibaba Cloud account UID	Enter the UID of the Alibaba Cloud account for Account B.
   Accepter region type	Select Cross-region.
   Accepter region	The region of the DataWorks workspace and resource group in Account B. Select China (Shanghai).
   Accepter VPC instance	Manually enter the ID of the VPC associated with the DataWorks resource group in Account B (Account_B_shanghai_VPC).

2. Click OK. The peering connection is created with a Status of Pending Acceptance.

3. Log on to Account B. Go to the VPC Peering Connection console. In the top navigation bar, select the China (Shanghai) region. Find the incoming peering connection request and click Accept in the Actions column. After acceptance, the Status changes to Activated.

4. Click Configure Route under the Accepter VPC Instance. In the dialog box, enter a custom name for the route entry. Set Destination CIDR Block to the VPC CIDR block of the requester (the ECS instance): 192.168.0.0/16.

   

5. Log on to Account A. Go to the VPC Peering Connection console. In the top navigation bar, select the China (Hangzhou) region and find the peering connection you created.

6. Click Configure Route under the Requester VPC Instance. In the dialog box, enter a custom name for the route entry. Set Destination CIDR Block to the VPC CIDR block of the accepter (the DataWorks resource group): 172.16.0.0/12.

   

3. Add a route to the resource group

1. Log on to Account B. Go to the DataWorks resource group list. Find the target resource group and click Network Settings in the Actions column.

2. Under the relevant feature module, find the associated VPC and click Custom Route in the Actions column.

3. Click Add Route. For Connection Method, select CIDR Block. For Destination CIDR Block, enter the CIDR block of the vSwitch where the ECS instance is located: 192.168.6.0/24.

4. Enable remote database access

Connect to the ECS instance that hosts the MySQL database and enable remote access.

The following commands apply to MySQL 8.0 on Linux. Adapt the steps for other operating systems or MySQL versions.

1. Find the my.cnf configuration file. With a default installation, it is typically at /etc/my.cnf.

   find / -name my.cnf

2. Open the file for editing. Replace the path if your my.cnf is in a different location.

   vim /etc/my.cnf

3. At the end of the file, press i to enter insert mode and add the following line under [mysqld]:

   bind-address=0.0.0.0

4. Press Esc, then enter :wq! to save and exit.

5. Restart the MySQL service.

   systemctl restart mysqld

6. Create a database user for DataWorks to use when connecting remotely.

   1. Log on to the database as the administrator.

      mysql -u root -p

   2. Create a user and set a password.

      -- "dataworks_user" is the username. Customize as needed. -- "%" allows connections from any IP address. Replace with a specific IP for finer-grained control. -- "StrongPassword123!" is the password. Customize as needed. CREATE USER 'dataworks_user'@'%' IDENTIFIED BY 'StrongPassword123!';

   3. Grant the user access to the database.

      -- Run one of the following commands. -- Grants all privileges on all databases. Use with caution. GRANT ALL PRIVILEGES ON *.* TO 'dataworks_user'@'%' WITH GRANT OPTION; -- Grants privileges on a specific database (for example, mydatabase). GRANT ALL PRIVILEGES ON mydatabase.* TO 'dataworks_user'@'%' WITH GRANT OPTION;

   4. Flush the privileges, then exit.

      FLUSH PRIVILEGES;

      exit

   5. Verify the remote connection.

      mysql -u dataworks_user -h <Private_IP_address_of_the_ECS_instance> -p

5. Configure the security group

1. Log on to Account A. Go to the Elastic Compute Service console. In the top navigation bar, select the China (Hangzhou) region.

2. In the left-side navigation pane, choose Instances. Find the ECS instance that hosts the MySQL database and click the instance name to open the Instance Details page.

3. Click the Security Groups tab, then click the name of the security group to open the Security Group Details page.

4. In the Rules section, click Add Rule and configure the following parameters. Keep the default values for all other parameters.

   Parameter	Value
   Source	The CIDR block of the DataWorks resource group's vSwitch: 172.16.66.0/24
   Port Range	3306

6. Test the connection

1. Log on to Account B.

2. Log on to the DataWorks console. In the top navigation bar, select the target region. In the left-side navigation pane, choose Data Integration > Data Integration. Select the target workspace from the drop-down list and click Go to Data Integration.

3. In the left-side navigation pane, click Data source to open the Data Sources page, then click Add Data Source.

4. Select the MySQL data source type and configure the following parameters.

   Parameter	Value
   Configuration Mode	Connection String Mode
   Host IP Address	The private IP address of the ECS instance: 192.168.6.172
   Port Number	3306
   Database Name	The name of an existing database
   Username	dataworks_user (created in step 4)
   Password	The password set in step 4

5. In the Connection Configuration section, click Test Network Connectivity for the associated resource group. Verify that the result is passed.

   If the connectivity test fails, use the Network Connectivity Diagnosis Tool to troubleshoot. If the problem persists, submit a ticket for assistance.