A workspace for data warehouse development consists of two parts: data warehouse solutions and business scenarios. Data warehouse solutions allow you to create and run real-time synchronization and migration tasks to migrate or integrate full data and incremental data in a quasi-real-time manner. This way, data migration and integration needs in business scenarios can be met.

You can create a data warehouse solution for the synchronization of data to online databases based on the data amount and required synchronization efficiency. You can create the following types of data warehouse solutions:
  • Real-time synchronization: transmits data by using the data synchronization feature of Data Transmission Service (DTS). For more information about how to create a real-time synchronization task, see the Create a real-time synchronization task section of this topic.
  • Real-time migration: transmits data by using the data migration feature of DTS. For more information about how to create a real-time migration task, see the Create a real-time migration task section of this topic.
Note

Create a real-time synchronization task

  1. Go to the DMS console V5.0.
  2. In the top navigation bar, click DTS. In the left-side navigation pane, choose Data Development > Data Warehouse Development.
  3. Click the name of the workspace in which you want to create a real-time synchronization task.
  4. In the left-side navigation pane of the workspace, click the jai icon and choose Data Warehouse Solutions > Real-time synchronization.
    Note You can also right-click Data Warehouse Solutions in the left-side navigation pane of the workspace and choose New > Real-time synchronization.
  5. Create and purchase a real-time synchronization task.

Create a real-time migration task

  1. Go to the DMS console V5.0.
  2. In the top navigation bar, click DTS. In the left-side navigation pane, choose Data Development > Data Warehouse Development.
  3. Click the name of the workspace in which you want to create a real-time migration task.
  4. In the left-side navigation pane of the workspace, click the jai icon and choose Data Warehouse Solutions > Real-time Migration.
    Note You can also right-click Data Warehouse Solutions in the left-side navigation pane of the workspace and choose New > Real-time Migration.
  5. Create and purchase a real-time migration task.

What are the differences between data migration and data synchronization?

Item Data migration Data synchronization
Scenarios The data migration feature is used to migrate data from on-premises databases, user-created databases hosted on ECS, and databases on third-party cloud platforms to Alibaba Cloud.

You can release a data migration task immediately after it is complete.

The data synchronization feature is used to synchronize data between two data sources in real time. It is suitable for scenarios such as active geo-redundancy, disaster recovery, cross-border data synchronization, query load balancing, cloud BI systems, and real-time data warehousing.

After you create a data synchronization task, it continuously synchronizes data between the specified data sources to ensure data consistency.

Supported databases For more information, see Supported databases. For more information, see Supported databases.
Supported deployment locations of databases
  • User-created database with a public IP address
  • User-created database hosted on ECS
  • User-created database connected over Express Connect, VPN Gateway, or Smart Access Gateway
  • User-created database hosted on ECS
  • User-created database connected over Express Connect, VPN Gateway, or Smart Access Gateway
Note The data synchronization feature ensures low network latency through data transmission over the internal network.
Features You can read and migrate data across user-created databases that are deployed on VPCs owned by different Alibaba cloud accounts.
  • You can change the names of objects such as columns, tables, and databases.
  • You can filter the data to be synchronized.
  • You can modify the objects to be synchronized.
  • You can configure two-way data synchronization between MySQL databases.
  • You can select the types of operations to be synchronized. For example, you can synchronize only INSERT operations.
Billing methods Only the pay-as-you-go billing method is supported. The pay-as-you-go and subscription billing methods are supported.
Billing rules You are billed when incremental data migration is in progress, including the period when incremental data migration is paused. You are not billed for schema migration and full data migration.
  • If you use the pay-as-you-go billing method, billing starts after the task is configured and started. You are also billed when the task is paused.
  • If you use the subscription billing method, the fee is deducted at the time of purchase based on the quantity and configurations you select.
Note For databases that are not supported by the data synchronization feature (such as databases on ApsaraDB for MongoDB instances), you can perform incremental data migration. Incremental data migration can ensure that data is synchronized between the source and destination database.