A workspace for data warehouse development consists of two parts: data warehouse solutions and business scenarios. Data warehouse solutions allow you to create and run real-time synchronization and migration tasks to migrate or integrate full data and incremental data in a quasi-real-time manner. This way, data migration and integration needs in business scenarios can be met.

You can create a data warehouse solution for the synchronization of data to online databases based on the data amount and required synchronization efficiency. You can create the following types of data warehouse solutions:
  • Real-time synchronization: transmits data by using the data synchronization feature of Data Transmission Service (DTS). For more information about how to create a real-time synchronization task, see the Create a real-time synchronization task section of this topic.
  • Real-time migration: transmits data by using the data migration feature of DTS. For more information about how to create a real-time migration task, see the Create a real-time migration task section of this topic.
Note

Create a real-time synchronization task

  1. Log on to the DMS console V5.0.
  2. In the top navigation bar, click DTS. In the left-side navigation pane, choose Data Development > Data Warehouse Development.
  3. Click the name of the workspace in which you want to create a real-time synchronization task.
  4. In the left-side navigation pane of the workspace, click the jai icon and choose Data Warehouse Solutions > Real-time synchronization.
    Note You can also right-click Data Warehouse Solutions in the left-side navigation pane of the workspace and choose New > Real-time synchronization.
  5. Create and purchase a real-time synchronization task.

Create a real-time migration task

  1. Log on to the DMS console V5.0.
  2. In the top navigation bar, click DTS. In the left-side navigation pane, choose Data Development > Data Warehouse Development.
  3. Click the name of the workspace in which you want to create a real-time migration task.
  4. In the left-side navigation pane of the workspace, click the jai icon and choose Data Warehouse Solutions > Real-time Migration.
    Note You can also right-click Data Warehouse Solutions in the left-side navigation pane of the workspace and choose New > Real-time Migration.
  5. Create and purchase a real-time migration task.

What are the differences between data migration and data synchronization?

ItemData migrationData synchronization
ScenariosThe data migration feature is used to migrate data from on-premises databases, self-managed databases hosted on Elastic Compute Service (ECS), and databases on third-party cloud vendors to Alibaba Cloud.

You can release a data migration task immediately after it is complete.

The data synchronization feature is used to synchronize data between two data sources in real time. It is suitable for scenarios such as active geo-redundancy, disaster recovery, cross-border data synchronization, query load balancing, cloud BI systems, and real-time data warehousing.

After you create a data synchronization task, it continuously synchronizes data between the specified data sources to ensure data consistency.

Supported database servicesFor more information, see Overview of data migration scenarios. For more information, see Overview of data synchronization scenarios.
Supported deployment environments of databases
  • Self-managed database with a public IP address
  • Self-managed database without a public IP address or port number (connected over Database Gateway)
  • Self-managed database connected over Cloud Enterprise Network (CEN)
  • Self-managed database hosted on ECS
  • Self-managed database connected over Express Connect, VPN Gateway, or Smart Access Gateway
  • Self-managed database hosted on ECS
  • Self-managed database connected over Express Connect, VPN Gateway, or Smart Access Gateway
  • Self-managed database without a public IP address or port number (connected over Database Gateway)
  • Self-managed database connected over CEN
Note The data synchronization feature ensures low network latency through data transmission over an internal network.
Features
  • You can enable object name mapping for columns, tables, and databases.
  • You can filter the data to be migrated.
  • You can select the types of SQL operations to be synchronized. For example, you can synchronize only INSERT operations.
  • You can read and migrate data across self-managed databases that are deployed in virtual private clouds (VPCs) owned by different Alibaba Cloud accounts.
  • You can enable object name mapping for columns, tables, and databases.
  • You can filter the data to be synchronized.
  • You can modify the objects to be synchronized.
  • You can configure two-way data synchronization between MySQL databases.
  • You can select the types of SQL operations to be synchronized. For example, you can synchronize only INSERT operations.
Billing methodsOnly the pay-as-you-go billing method is supported. The pay-as-you-go and subscription billing methods are supported.
Billing rulesYou are billed only when incremental data migration is in progress, including the period when incremental data migration is paused. You are not billed for schema migration and full data migration.
  • If you use the pay-as-you-go billing method, billing starts after the task is configured and started. You are also billed when the task is paused.
  • If you use the subscription billing method, the fee is deducted at the time of purchase based on the selected quantity and configurations.
Note For databases that are not supported by the data synchronization feature (such as databases on ApsaraDB for MongoDB instances), you can perform incremental data migration. Incremental data migration can ensure that data is synchronized between the source and destination database.