The Data Integration service of DataWorks allows you to use a synchronization solution to synchronize data from a source to a destination in real time or in batch mode. You can use a synchronization solution to synchronize multiple tables at a time or synchronize both full and incremental data. If you want to synchronize both full and incremental data, you can synchronize the incremental data after the full data is synchronized.

Go to the Tasks page

  1. Log on to the DataWorks console.
  2. In the left-side navigation pane, click Workspaces.
  3. In the top navigation bar, select the region in which your workspace resides. Find the workspace and click Data Integration in the Actions column.
  4. In the left-side navigation pane, choose Sync Solutions > Tasks. The Tasks page appears.
    You can create synchronization tasks and view the status of the created synchronization tasks on this page.
    When you create a synchronization task, you can select a data synchronization solution as needed. For more information, see Select a data synchronization solution. A synchronization task can be in the following states:
    • Not Running: The synchronization task is not run. You can click Submit and Run in the Operation column for the synchronization task to run the synchronization task.
      Note You can also click Modify Configuration in the Operation column for the synchronization task in the Not Running state to edit the synchronization task. If you click Modify Configuration in the Operation column for a synchronization task in another state, you can only view the information about the synchronization task.
    • Running: The synchronization task is running and cannot be terminated. You must wait until the synchronization task is complete.
    • Exception: An error occurred when the synchronization task is run. You can click Execution details in the Operation column for the synchronization task to troubleshoot the error.
    • Succeeded: The synchronization task is complete. You can click Execution details in the Operation column for the synchronization task to view the results of the synchronization task.

Select a data synchronization solution

  1. On the Tasks page, click New task in the upper-right corner.
  2. On the Create Data Synchronization Solution page, select the source and destination for data synchronization, and then select a data synchronization solution.
    For more information about the supported source and destination data stores, see Supported data sources. The following figure shows the supported data synchronization solutions. Supported data synchronization solutionsDataWorks supports the following data synchronization solutions, which are classified based on the destination data store:
    • One-click real-time synchronization to DataHub: used to synchronize data to DataHub
    • One-click realtime synchronization to Elasticsearch: used to synchronize data to Elasticsearch.
    • One-click real-time synchronization to Hologres: used to synchronize data to Hologres.
    • One-click realtime synchronization to AnalyticDB MySQL 3.0: used to synchronize data to AnalyticDB for MySQL V3.0.
    • Data synchronization solutions for synchronizing data to MaxCompute, including:
      • One-click real-time synchronization to MaxCompute
      • One-click batch synchronization to MaxCompute (Cyclical Full)
      • One-click batch synchronization to MaxCompute (Cyclical Increment)
      • One-click batch synchronization to MaxCompute (Once Full)
      • One-click batch synchronization to MaxCompute (Once Increment)
      • One-click batch synchronization to MaxCompute (Once Full then cyclical increment)