Before you use DataWorks to synchronize data from ApsaraDB for OceanBase to DataHub, you must refer to the operations in this topic to prepare the configurations, such as network environments, whitelists, and permissions, for both the source and destination.

Prerequisites

Before you configure a data source, make sure that the following operations are performed:
  • Prepare data sources: An ApsaraDB for OceanBase cluster and a DataHub project are prepared.
  • Plan and prepare resources: An exclusive resource group for data integration is purchased and configured. For more information, see Plan and configure resources.
  • Evaluate and plan the network environment: Before you perform data integration, connect data sources to exclusive resource groups for data integration based on your business requirements. After data sources and exclusive resource groups for data integration are connected, you can refer to the operations in this topic to configure access settings such as vSwitches and whitelists.
    • If data sources and exclusive resource groups for data integration reside in the same region and virtual private cloud (VPC), they are automatically connected.
    • If data sources and exclusive resource groups for data integration reside in different network environments, you must connect data sources and resource groups by using methods such as a VPN gateway.

Background information

Before you synchronize data from the source to the destination, make sure that the data sources and exclusive resource groups for data integration are connected. In addition, you must create an account and authorize the account to access the data sources.
  • Configure whitelists for data sources
    If the data sources and exclusive resource group for data integration reside in the same VPC, you must add the CIDR block of the exclusive resource group for data integration to the whitelists of the data sources. This ensures that the exclusive resource group for data integration can be used to access the data sources.VPC connection
  • Create an account and authorize the account

    You must create an account that can be used to access data sources, read data from the source data source, and write data to the destination data source in the data integration process.

Limits

ApsaraDB for OceabBase is a distributed relational database that can integrate data distributed in multiple physical databases into a unified logical database. However, you can synchronize data of only one physical ApsaraDB for OceanBase database to DataHub in real time.

Procedure

  1. Configure a whitelist for the ApsaraDB for OceanBase cluster.
    Add the CIDR block of the VPC where the exclusive resource group resides to the whitelist of the ApsaraDB for OceanBase cluster.
    1. View and record the elastic IP address (EIP) and CIDR block of the exclusive resource group.
      1. Log on to the DataWorks console.
      2. In the left-side navigation pane, click Resource Groups.
        • Obtain the CIDR block of the vSwitch to which the exclusive resource group is bound.

          To synchronize data to or from a data store in a virtual private cloud (VPC), you must obtain and add the CIDR block of the vSwitch to which the exclusive resource group is bound to the whitelist of the data store. To obtain the vSwitch CIDR block, perform the following steps:

          On the Exclusive Resource Groups tab, find the resource group whose information you want to view and click Network Settings in the Actions column. On the page that appears, obtain the value of the VSwitch CIDR Block parameter and add the value to the whitelist of the data store. vSwitch CIDR block
        • Obtain the EIP and CIDR block of the exclusive resource group.

          To synchronize data over the Internet, you must obtain and add the EIP of the exclusive resource group to the whitelist of the data store. To obtain the EIP, perform the following steps:

          On the Exclusive Resource Groups tab, find the resource group whose information you want to view and click View Information in the Actions column. In the Exclusive Resource Groups dialog box, click to copy the values of the EIPAddress and CIDR Blocks parameters. Then, add the values to the whitelist of the data store. EIP
    2. Add the elastic IP address (EIP) and CIDR block of the exclusive resource group for data integration to the whitelist of the ApsaraDB for OceanBase cluster. For more information, see Configure a whitelist for an ApsaraDB for OceanBase cluster of OceanBase.
  2. Create an account and grant the required permissions to the account.
    You must create an account to log on to the database of the ApsaraDB for OceanBase cluster. You must grant the required permissions on the database to the account. For more information, see Create an account of OceanBase.

What to do next

After data sources are configured, the source data source, destination data source, and exclusive resource group for data integration are connected. Then, the exclusive resource group for data integration can be used to access data sources. You can add the source data source and destination data source to DataWorks, and associate them with a data synchronization solution when you create the solution.

For more information about how to add a data source, see Add a data source.