View here to log in or access your console

OK

Data Transmission Service

Supports data migration and data synchronization between data engines, such as relational database, NoSQL and OLAP

Buy Now Contact Sales

Overview

Data Transmission Service (DTS) helps you migrate data between data storages, such as relational database, NoSQL, and OLAP. The service supports homogenous migrations as well as heterogeneous migration between different data storages.

DTS also can be used for continuous data replication with high-availability. In addition, DTS can help you subscribe to the change data function of ApsaraDB for RDS. With DTS, you can easily implement scenarios such as data migration, remote real-time data backup, real-time data integration and cache refresh.


Benefits

Zero Downtime

  • Data Transmission Service helps you migrate data with virtually no downtime. All data changes to the source database that occurs during the migration is continuously replicated to the target, allowing the source database to remain fully operational during the migration process. After the database migration is complete, the target database will remain synchronized with the source for as long as you choose, allowing you to switch over the database at a convenient time.

High Performance

  • DTS's high performance supports replication in parallel, and supports multiple network optimization features, such as data compression and packet retransmission.

  • The rate of migrating existing data can be up to 70 MB/s.

  • The rate of replicating change data can be up to 30,000+ records per second.

Supports Most Widely Used Databases

  • DTS can migrate your data to and from most of the widely used commercial and open source databases. It supports homogeneous migrations such as MySQL to MySQL, as well as heterogeneous migrations between different database platforms, such as Oracle to MySQL.

  • Migrations can be from on-premises databases to Amazon RDS or Amazon EC2, databases running on EC2 to RDS, or vice versa, as well as from one RDS database to another RDS database.

  • DTS supports multiple transmission modes, such as data migration, real-time data replication, and change data subscription.

Reliable

  • DTS continually monitors all transmission tasks. In the event of interruption, the task will be restarted and the migration continued from where it was halted.

  • DTS continually monitors the source and target databases, when the connection changes, DTS dynamically modifies the connection in order to optimize performance.

Simple-to-Use

  • You can begin a database migration with just a few clicks from the DTS Management Console.

  • DTS manages all the complexities of the migration process including automatically replicating data changes that occur in the source database during the migration process.

  • You can monitor and manage your tasks in the management console anytime, anywhere.

Product Details

Data Transmission Service (DTS) supports homogenous migrations such as MySQL to MySQL, as well as heterogeneous migration between different data engines, such as Oracle to MySQL. During the migration, the source database remains fully operational, minimizing downtime to applications that rely on the source database.

DTS can be used for continuous data replication with high-availablity. With this solution, customers can perform remote real-time data backup, reducing the latency for remote access, real-time big data analytics initiatives and so forth.
In addition, DTS also can help you subscribe to the change data of ApsaraDB for RDS. With this solution, you can perform message notify, cache refresh and data replication with complicate data processing.

DTS allows you to stream data to Analytic DB from ApsaraDB for RDS in real-time, without degrading the performance of the source production systems.


Features

Data Migration

Zero Downtime

  • All data changes to the source database that occur during the migration are continuously replicated to the target, allowing the source database to be fully operational during the migration process.

  • After completion of the database migration, the target database will remain synchronized with the source for as long as you choose, allowing you to switch over the database at a convenient time.

Supports Most Widely Used Databases

  • DTS supports homogenous migration such as MySQL to MySQL, SQLServer to SQLServer, as well as heterogeneous migration such as Oracle to MySQL.

  • DTS supports heterogeneous migrations between different database platforms. Migrations can be from on-premises databases to ApsaraDB for RDS or Alibaba Cloud ECS, databases running on ECS to RDS, or vice versa, as well as from one RDS database to another RDS database.

Real-Time Data Replication

  • DTS supports real-time data synchronization from one RDS database to another RDS database.

  • You can modify the synchronization object during the synchronization process.

Real-Time Change Data Subscription

  • DTS supports real-time subscribing of change data of RDS.

  • You can modify the subscription object after subscription instance created.

Automatic Monitoring

  • Provides crucial instance information like replication delay, transmission status, and consumption delay in real-time so that you can monitor and protect business critical applications.

Pricing

Data Transmission Service is charged based according to three models: Data Synchronization, Data Subscription and Data Migration

Data migration however only supports on a Pay-As-You-Go payment model, which charges configuration fee and Internet traffic fee. Configuration fees are only charged for normal run time of data replication, and Internet traffic charges temporarily are not charged.


Data Synchronization

Dest Region Instance Specification Configuration Fee (Annual Price) Configuration Fee (Monthly Price) Configuration Fee (Pay-as-you-go)
Singapore-Singapore micro US$1180.8 US$118.08 US$0.246
Singapore-Singapore small US$1785.6 US$178.56 US$0.372
Singapore-Singapore medium US$2688.0 US$268.80 US$0.56
Singapore-Singappre large US$4017.6 US$401.76 US$0.837
Singapore-HongKong micro US$8568.0 US$856.80 US$1.785
Singapore-HongKong small US$12864.0 US$1286.40 US$2.680
Singapore-HongKong medium US$19296.0 US$1929.60 US$4.020
Singapore-HongKong large US$28939.2 US$2893.92 US$6.029
Singapore-US East micro US$10286.4 US$1028.64 US$2.143
Singapore-US East small US$15432.0 US$1543.20 US$3.215
Singapore-US East medium US$23150.4 US$2315.04 US$4.823
Singapore-US East large US$34728.0 US$3472.80 US$7.235
Singapore-US West micro US$8568.0 US$856.80 US$1.785
Singapore-US West small US$12864.0 US$1286.40 US$2.680
Singapore-US West medium US$19296.0 US$1929.60 US$4.020
Singapore-US West large US$28939.2 US$2893.92 US$6.029
Singapore-China Mainland micro US$8568.0 US$856.80 US$1.785
Singapore-China Mainland small US$12864.0 US$1286.40 US$2.680
Singapore-China Mainland medium US$19296.0 US$1929.60 US$4.020
Singapore-China Mainland large US$28939.2 US$2893.92 US$6.029
Dest Region Instance Specification Configuration Fee (Annual Price) Configuration Fee (Monthly Price) Configuration Fee (Pay-as-you-go)
HongKong-Singapore micro US$8568.0 US$856.80 US$1.785
HongKong-Singapore small US$12864.0 US$1286.40 US$2.680
HongKong-Singapore medium US$19296.0 US$1929.60 US$4.020
HongKong-Singapore large US$28939.2 US$2893.92 US$6.029
HongKong-HongKong micro US$1180.8 US$118.08 US$0.246
HongKong-HongKong small US$1785.6 US$178.56 US$0.372
HongKong-HongKong medium US$2688.0 US$268.80 US$0.56
HongKong-HongKong large US$4017.6 US$401.76 US$0.837
HongKong-US East micro US$8956.8 US$895.68 US$1.866
HongKong-US East small US$13440.0 US$1344.00 US$2.800
HongKong-US East medium US$20160.0 US$2016.00 US$4.200
HongKong-US East large US$30240.0 US$3024.00 US$6.300
HongKong-US West micro US$7459.2 US$745.92 US$1.554
HongKong-US West small US$11203.2 US$1120.32 US$2.334
HongKong-US West medium US$16800.0 US$1680.00 US$3.500
HongKong-US West large US$25204.8 US$2520.48 US$5.251
HongKong-China Mainland micro US$6720.0 US$672.00 US$1.400
HongKong-China Mainland small US$10094.4 US$1009.44 US$2.103
HongKong-China Mainland medium US$15139.2 US$1513.92 US$3.154
HongKong-China Mainland large US$22708.8 US$2270.88 US$4.731
Dest Region Instance Specification Configuration Fee (Annual Price) Configuration Fee (Monthly Price) Configuration Fee (Pay-as-you-go)
US East-Singapore micro US$10286.4 US$1028.64 US$2.143
US East-Singapore small US$15432.0 US$1543.20 US$3.215
US East-Singapore medium US$23150.4 US$2315.04 US$4.823
US East-Singapore large US$34728.0 US$3472.80 US$7.235
US East-HongKong micro US$8956.8 US$895.68 US$1.866
US East-HongKong small US$13440.0 US$1344.00 US$2.800
US East-HongKong medium US$20160.0 US$2016.00 US$4.200
US East-HongKong large US$30240.0 US$3024.00 US$6.300
US East-US East micro US$1180.8 US$118.08 US$0.246
US East-US East small US$1785.6 US$178.56 US$0.372
US East-US East medium US$2688.0 US$268.80 US$0.56
US East-US East large US$4017.6 US$401.76 US$0.837
US East-US West micro US$2443.2 US$244.32 US$0.509
US East-US West small US$3676.8 US$367.68 US$0.766
US East-US West medium US$5524.8 US$552.48 US$1.151
US East-US West large US$8294.4 US$829.44 US$1.728
US East-China Mainland micro US$8956.8 US$895.68 US$1.866
US East-China Mainland small US$13440.0 US$1344.00 US$2.800
US East-China Mainland medium US$20160.0 US$2016.00 US$4.200
US East-China Mainland large US$30240.0 US$3024.00 US$6.300
Dest Region Instance Specification Configuration Fee (Annual Price) Configuration Fee (Monthly Price) Configuration Fee (Pay-as-you-go)
US West-Singapore micro US$8568.0 US$856.80 US$1.785
US West-Singapore small US$12864.0 US$1286.40 US$2.680
US West-Singapore medium US$19296.0 US$1929.60 US$4.020
US West-Singapore large US$28939.2 US$2893.92 US$6.029
US West-HongKong micro US$7459.2 US$745.92 US$1.554
US West-HongKong small US$11203.2 US$1120.32 US$2.334
US West-HongKong medium US$16800.0 US$1680.00 US$3.500
US West-HongKong large US$25204.8 US$2520.48 US$5.251
US West-US East micro US$2443.2 US$244.32 US$0.509
US West-US East small US$3676.8 US$367.68 US$0.766
US West-US East medium US$5524.8 US$552.48 US$1.151
US West-US East large US$8294.4 US$829.44 US$1.728
US West-US West micro US$1180.8 US$118.08 US$0.246
US West-US West small US$1785.6 US$178.56 US$0.372
US West-US West medium US$2688.0 US$268.80 US$0.56
US West-US West large US$4017.6 US$401.76 US$0.837
US West-China Mainland micro US$7459.2 US$745.92 US$1.554
US West-China Mainland small US$11203.2 US$1120.32 US$2.334
US West-China Mainland medium US$16800.0 US$1680.00 US$3.500
US West-China Mainland large US$25204.8 US$2520.48 US$5.251
Dest Region Instance Specification Configuration Fee (Annual Price) Configuration Fee (Monthly Price) Configuration Fee (Pay-as-you-go)
China Mainland-Singapore micro US$8568.0 US$856.80 US$1.785
China Mainland-Singapore small US$12864.0 US$1286.40 US$2.680
China Mainland-Singapore medium US$19296.0 US$1929.60 US$4.020
China Mainland-Singapore large US$28939.2 US$2893.92 US$6.029
China Mainland-HongKong micro US$6720.0 US$672.00 US$1.400
China Mainland-HongKong small US$10094.4 US$1009.44 US$2.103
China Mainland-HongKong medium US$15139.2 US$1513.92 US$3.154
China Mainland-HongKong large US$22708.8 US$2270.88 US$4.731
China Mainland-US East micro US$8956.8 US$895.68 US$1.866
China Mainland-US East small US$13440.0 US$1344.00 US$2.800
China Mainland-US East meidum US$20160.0 US$2016.00 US$4.200
China Mainland-US East large US$30240.0 US$3024.00 US$6.300
China Mainland-US West micro US$7459.2 US$745.92 US$1.554
China Mainland-US West small US$11203.2 US$1120.32 US$2.334
China Mainland-US West medium US$16800.0 US$1680.00 US$3.500
China Mainland-US West large US$25204.8 US$2520.48 US$5.251
Data Synchronization between regions in china mainland micro US$1675.2 US$167.52 US$0.349
Data Synchronization between regions in china mainland small US$2524.8 US$252.48 US$0.526
Data Synchronization between regions in china mainland medium US$3787.2 US$378.72 US$0.789
Data Synchronization between regions in china mainland large US$5678.4 US$567.84 US$1.183
Data synchronization between two instance in the same region in china mainland micro US$1180.8 US$118.08 US$0.246
data synchronization between two instance in the same region in china mainland small US$1785.6 US$178.56 US$0.372
Data synchronization between two instance in the same region in china mainland medium US$2688.0 US$268.80 US$0.56
Data synchronization between two instance in the same region in china mainland large US$4017.6 US$401.76 US$0.837

(1) Payment Method: Pay-As-You-Go and Monthly Subscription
(2) Charging Items: Instance configuration fee
(3) Cross-border data synchronization is not opened for everyone, if you need to use, please submit request to us.


Data Subscription

Instance Region Configuration Fee (annual price) Configuration Fee (monthly price) Configuration Fee (Pay-As-You-Go) Data Traffic Fee Internet Traffic Fee
Hangzhou US$1813.50 US$181.350 US$0.378 US$0.154 US$0.123
Shanghai US$1813.50 US$181.350 US$0.378 US$0.154 US$0.123
Qingdao US$1813.50 US$181.350 US$0.378 US$0.154 US$0.123
Beijing US$1813.50 US$181.350 US$0.378 US$0.154 US$0.123
Shenzhen US$1813.50 US$181.350 US$0.378 US$0.154 US$0.123
Hong Kong US$2261.50 US$226.150 US$0.470 US$0.154 US$0.153
Singapore US$3489.20 US$348.920 US$0.730 US$0.154 US$0.081
US East US$3553.80 US$355.380 US$0.740 US$0.154 US$0.077

(1) Payment Mode: Pay-As-You-Go and Monthly Subscription.
(2) Charging Items: Instance configuration fee, data traffic costs, internet traffic fee.
(3) The data traffic fee charged according to the actual amount of data subscribed by the SDK. Data traffic charges are temporarily not charged.
(4) The internet traffic fee is temporarily not charged.


Data Migration

Instance Region Instance Specification Configuration Fee (Pay-As-You-Go) Internet Traffic Fee
China Mainland Small US$0.158 US$0.123
China Mainland Medium US$0.287 US$0.123
China Mainland Large US$0.462 US$0.123
Hong Kong Small US$0.179 US$0.153
Hong Kong Medium US$0.320 US$0.153
Hong Kong Large US$0.517 US$0.153
Singapore Small US$0.278 US$0.081
Singapore Medium US$0.550 US$0.081
Singapore Large US$0.955 US$0.081
US West Small US$0.162 US$0.077
US West Medium US$0.320 US$0.077
US West Large US$0.646 US$0.077

(1) Instance configuration fee: Only the normal run time of data replication charged. The run time of migrating object structure and migrating existing data do not charged.
(2) Internet traffic fee is temporarily not charged.


Scenarios

The following are a few common DTS scenarios:

1) Database Migration With No Downtime

  • Data Transmission Service helps you migrate data with virtually no downtime. All data changes to the source database that occur during the migration are continuously replicated to the target, allowing the source database to be fully operational during the migration process. After the database migration is complete, the target database will remain synchronized with the source for as long as you choose, allowing you to switchover the database at a convenient time.

Recommended Configuration

Zero downtime migration

2) Remote Data Disaster Recovery

  • With DTS, you can perform real-time data replication between two RDS instance in deferent regions. The remote disaster recovery instance is a slave of the primary instance. When disaster occur, applications can switch to the remote disaster recovery instance from the primary instance to guarantee business availability.

Recommended Configuration

Off-site disaster preparation

3) Decrease Remote Access

  • When an application deploys in a single region, user access from other regions will suffer access latency and poor user experience. To improve access experience, you utilize use the recommended architecture as follows:

Recommended Configuration

Avoid cross-regional access
  • This architecture consists of a center and units. Write requests of users in all regions are routed back to the center. Data in the center is synchronized to units via DTS. Read requests of users in different regions may be routed to the nearby units so as to avoid remote access, and reduce access latency.

4) Real-time Big Data Analytics

  • DTS provides optimized and high performance delivery to Analytic DB from RDS to support customers with their real-time big data analytics initiatives. With this solution, customers can perform ad-hoc discovery, organization, and enrichment of low-latency data before it traverses to more refined sets of analytics tools.

Recommended Configuration

Online to offline real-time data channel

5) Cache Refresh

  • In order to support high-speed access to data, you may use caching services with RDS. With data subscription of DTS, you can perform low latency cache refresh, without degrading the performance of the RDS instance.

Recommended Configuration

Cache update
  • DTS can subscribe to change data of the RDS instance in real-time. It can also refresh cached data when data of RDS is changed.

6) Message Notify

  • When two applications have asynchronous coupling, you can use data subscription of DTS to perform low latency message notification without degrading the performance of the source application. With data subscription, you don’t have to publish messages during the source application. With this solution, you can therefore make the core application more stable and reliable.

Recommended Configuration

Notification

Getting Started

Quickly create and manage your DTS instances from the DTS Management Console.

Using DTS via the Management Console

Alibaba Cloud Management Console provides a simple Web-based user interface that allows you to create and manage your data transmission task.

Using the Console, you can create, modify, and manage data transmission tasks. Change the class of the used resources and monitor the data transmission tasks.

For a step-by-step overview on how to manage and operate your DTS instance through the Management Console, read the Quick Start

Access DTS Product Documentation

DTS product documentation walks you through the product architecture, implementation principle, and detailed user guide.

To create your own DTS instance, read the DTS Documentation to get a detailed understanding of how DTS works and how to modify and manage your DTS instance. The documentation will also help you understand best practices in using DTS.

Resources

The links below will take you to SDKs and important documentation. These links will help developers integrate RDS with their existing applications.

FAQs

1. Does DTS support data migration between RDS instances under two different Alibaba Cloud accounts?

Yes. When migrating data between RDS instances under different Alibaba Cloud accounts, you need to login DTS console with the account of the target RDS instance.
When configuring the migration task, you need to select on-permit databases with public IP addresses for the source instance,and configure the connection of the source RDS instance.

2. Does DTS support migrating the change data of the source instance during data migration?

Yes. All data changes to the source database that occur during the migration are continuously replicated to the target. DTS allows the source database to be fully operational during the migration process.

3. What are the basic principles of change data migration through DTS?

The basic principles of change data migration through DTS are described below:
During data migration, DTS starts the log parsing module to capture and parse the change logs of the source database in real-time. Then, DTS starts migrating the existing data. After data loading, DTS replicates the captured change data to the target instance, and the target database will remain synchronized with the source for as long as you choose.

4. Are tables locked during data migration through DTS?

When you choose migration existing data and replication change data, during the full data migration, DTS checks whether the source database contains any non-transactional tables having no primary keys (for example, MyISAM). If such tables exist, DTS places read-only locks on the tables to ensure data migration consistency. In other cases, DTS does not place locks on source databases.

5. Which network (intranet or Internet) is used to access ECS instance during data migration through DTS?

If the network type of the ECS instance is VPC, DTS connects to the ECS instance via the Internet.
If the ECS instance is the source instance of the migration task and is located in a region different from the target instance of the migration task, DTS connect to the ECS via Internet.
Otherwise, DTS connects to the ECS instance via an intranet.

6. Which network (intranet or Internet) is used to access the RDS instance during data migration through DTS?

If the RDS instance is the source instance of the migration task and is located in a region different from the target instance of the migration task, DTS connects to the RDS instance via the Internet.
Otherwise, DTS connects to the RDS instance via Intranet.

7. If the RDS instance is the source instance of the migration task and is located in a region different from the target instance of the migration task, DTS can connect to the RDS instance via Internet.<br/> Otherwise, DTS connects to the RDS instance via an Intranet.

If database type of the source instance is MySQL or MongoDB,then the DDL operation will be synchronized.
Otherwise,the DDL operation will not be synchronized.

8. Does DTS support migrating the database on a VPC ECS instance to an RDS instance?

Yes, but the ECS instance must be attached with an EIP address. When configuring the migration task, select the ECS instance for the source instance. DTS accesses the ECS instance via the EIP address of the ECS instance.

9. From which database (active/standby) does DTS capture data during data migration?

DTS captures data from the active database of the RDS instance during data migration.

10. Can DTS migrate the database C in the RDS instance A to the database D in the RDS instance B?

Yes. DTS supports database name mapping which allows data migration between two different databases in two RDS instances.

11. Is the data in the source database deleted after migration through DTS?

No. DTS only copies data in the source database during data migration, and thus the data in the source database is not affected.

12. Why have I received the following error: "Failed to obtain the structure object "[java.sql.SQLException: Io exception: The Network Adapter co" reported?

If such error is reported, DTS fails to connect to the source database. Possible causes include:
(1) The connection address is incorrect.
(2) The firewall is enabled for the local database.
(3) Remote listening is not enabled for the database.

13. What is the table "increment_trx" generated in the target database during data migration?

The table "increment_trx" is created by DTS. It is mainly used to record the checkpoint of migration. When the task is interrupt, DTS automatically restarts the process and continues the migration from the checkpoint recorded.
Do not drop the table; otherwise, the migration task fails.

14. Why is the size of the target RDS instance larger than the source database after migration through DTS.

DTS migrates data through SQL. It will generate binlog in the target instance. Therefore, the size of the target RDS instance after migration is larger than the source database.

15. Why have I received the following error: "java.sql.BatchUpdateException: INSERT, DELETE command denied to user 'user'"?

The general cause is that the target RDS instance is locked, and the write privilege of the account is revoked.
To resolve the problem, you should upgrade the space of the target RDS instance, and restart the task on the DTS Console.

16. Does the data within the tables of the target database overwritten during data migration through DTS?

No. The table of the target instance to be migrated needs to be empty before data migration. If the table to be migrated already exists in the target database, the precheck will fail.

17. How can I migrate a database to the RDS instance from another Alibaba Cloud account.

You will need to login to the DTS Console from the Alibaba Cloud account of the target RDS instance. Set the source instance type to on-permit database, and configure the connection of the source RDS instance.

18. Does the release of a finished migration task affect the use of the migrated database?

No.

19. Can DTS support the synchronization between on_permit database and the RDS instance?

Yes. You can use DTS to perform synchronization between the cloud instance and the on-permit database.

20. Which network (intranet or Internet) is used during data DTS synchronization?

DTS transfers data via intranet during data synchronization.

21. Why is it that my data subscription SDK cannot subscribe to any message and the prompt "client partition is empty, wait partition balance" is always reported?

Why my data subscription SDK cannot subscribe to any message and the prompt "client partition is empty, wait partition balance" is always reported.

22. Why is "keep alive error" reported at the data subscription SDK?

The consumption timestamp is not in the data range of the data subscription instance. You need to modify the consumption timestamp and restart the SDK.

23. Why does the system report an error<br/> "failed to get master store addr for topic aliyun_sz_ecs_ApsaraDBr*****y-1-0" when I use the data subscription function?

Firstly, check whether the sePublicIp in SDK is set to true.
If usePublicIp = true, check whether the consumption timestamp is within the data range of the subscription instance. If not, modify the consumption timestamp and restart the SDK.

24. Why does the system report an error <br/> "Specified signature is not matched with our calculation. at com.aliyuncs.DefaultAcsClient.parseAcsResponse(DefaultAcsClient.java:139) at" when I start the SDK for data subscription?

The Access Key/Access Secret configured in the SDK does not belong to the Alibaba Cloud account corresponding to the subscription instance. Modify Access Key/Access Secret and restart the SDK.

25. Can an SDK client subscribe to multiple channels?

No.

26.Why does the system report "get guid info failed" when I start SDK subscription?

The subscription instance ID set in the SDK is incorrect. You need to replace the "subscription instance ID in the sample code client with the ID of the subscription instance to which you want to subscribe.