Manage data warehouse solutions - Data Management - Alibaba Cloud Documentation Center

A workspace for data warehouse development consists of two parts: data warehouse solutions and business scenarios. Data warehouse solutions allow you to create and run real-time synchronization and migration tasks to migrate or integrate full data and incremental data in a quasi-real-time manner. This way, data migration and integration needs in business scenarios can be met.

You can create a data warehouse solution for the synchronization of data to online databases based on the data amount and required synchronization efficiency. You can create the following types of data warehouse solutions:

Real-time synchronization: transmits data by using the data synchronization feature of Data Transmission Service (DTS). For more information about how to create a real-time synchronization task, see the Create a real-time synchronization task section of this topic.
Real-time migration: transmits data by using the data migration feature of DTS. For more information about how to create a real-time migration task, see the Create a real-time migration task section of this topic.

Note

For DTS-based data synchronization and migration tasks, you can check the task status by using the DTS checkpoint nodes.
For more information about the differences between data synchronization and migration, see the What are the differences between data migration and data synchronization? section in this topic.

Create a real-time synchronization task

Log on to the DMS console V5.0.
In the top navigation bar, click DTS. In the left-side navigation pane, choose Data Development > Data Warehouse Development.
Click the name of the workspace in which you want to create a real-time synchronization task.
In the left-side navigation pane of the workspace, click the icon and choose Data Warehouse Solutions > Real-time synchronization.
Note You can also right-click Data Warehouse Solutions in the left-side navigation pane of the workspace and choose New > Real-time synchronization.
Create and purchase a real-time synchronization task.
DTS supports the following data synchronization scenarios. You can select one of the following scenarios based on your business requirements to view the supported database versions, synchronization types, and configuration procedure.

Create a real-time migration task

Log on to the DMS console V5.0.
In the top navigation bar, click DTS. In the left-side navigation pane, choose Data Development > Data Warehouse Development.
Click the name of the workspace in which you want to create a real-time migration task.
In the left-side navigation pane of the workspace, click the icon and choose Data Warehouse Solutions > Real-time Migration.
Note You can also right-click Data Warehouse Solutions in the left-side navigation pane of the workspace and choose New > Real-time Migration.
Create and purchase a real-time migration task.
DTS supports the following data migration solutions. Select the corresponding data migration solution based on your actual scenario to view the supported database versions, migration types, and configuration procedure.

What are the differences between data migration and data synchronization?


Item	Data migration	Data synchronization
Scenarios	The data migration feature is used to migrate data from on-premises databases, self-managed databases hosted on Elastic Compute Service (ECS), and databases on third-party cloud vendors to Alibaba Cloud. You can release a data migration task immediately after it is complete.	The data synchronization feature is used to synchronize data between two data sources in real time. It is suitable for scenarios such as active geo-redundancy, disaster recovery, cross-border data synchronization, query load balancing, cloud BI systems, and real-time data warehousing. After you create a data synchronization task, it continuously synchronizes data between the specified data sources to ensure data consistency.
Supported database services	For more information, see Overview of data migration scenarios.	For more information, see Overview of data synchronization scenarios.
Supported deployment environments of databases	Self-managed database with a public IP address Self-managed database without a public IP address or port number (connected over Database Gateway) Self-managed database connected over Cloud Enterprise Network (CEN) Self-managed database hosted on ECS Self-managed database connected over Express Connect, VPN Gateway, or Smart Access Gateway	Self-managed database hosted on ECS Self-managed database connected over Express Connect, VPN Gateway, or Smart Access Gateway Self-managed database without a public IP address or port number (connected over Database Gateway) Self-managed database connected over CEN Note The data synchronization feature ensures low network latency through data transmission over an internal network.
Features	You can enable object name mapping for columns, tables, and databases. You can filter the data to be migrated. You can select the types of SQL operations to be synchronized. For example, you can synchronize only INSERT operations. You can read and migrate data across self-managed databases that are deployed in virtual private clouds (VPCs) owned by different Alibaba Cloud accounts.	You can enable object name mapping for columns, tables, and databases. You can filter the data to be synchronized. You can modify the objects to be synchronized. You can configure two-way data synchronization between MySQL databases. You can select the types of SQL operations to be synchronized. For example, you can synchronize only INSERT operations.
Billing methods	Only the pay-as-you-go billing method is supported.	The pay-as-you-go and subscription billing methods are supported.
Billing rules	You are billed only when incremental data migration is in progress, including the period when incremental data migration is paused. You are not billed for schema migration and full data migration.	If you use the pay-as-you-go billing method, billing starts after the task is configured and started. You are also billed when the task is paused. If you use the subscription billing method, the fee is deducted at the time of purchase based on the selected quantity and configurations.

Note For databases that are not supported by the data synchronization feature (such as databases on ApsaraDB for MongoDB instances), you can perform incremental data migration. Incremental data migration can ensure that data is synchronized between the source and destination database.