View here to log in or access your console

OK

Data Transmission Service

Supports data migration and data synchronization between data engines, such as relational database, NoSQL and OLAP

Buy Now Contact Sales

Overview

Data Transmission Service (DTS) helps you migrate data between data storages, such as relational database, NoSQL, and OLAP. The service supports homogenous migrations as well as heterogeneous migration between different data storages.

DTS also can be used for continuous data replication with high-availability. In addition, DTS can help you subscribe to the change data function of ApsaraDB for RDS. With DTS, you can easily implement scenarios such as data migration, remote real-time data backup, real-time data integration and cache refresh.


Benefits

Zero Downtime

  • Data Transmission Service helps you migrate data with virtually no downtime. All data changes to the source database that occurs during the migration is continuously replicated to the target, allowing the source database to remain fully operational during the migration process. After the database migration is complete, the target database will remain synchronized with the source for as long as you choose, allowing you to switch over the database at a convenient time.

High Performance

  • DTS's high performance supports replication in parallel, and supports multiple network optimization features, such as data compression and packet retransmission.

  • The rate of migrating existing data can be up to 70 MB/s.

  • The rate of replicating change data can be up to 30,000+ records per second.

Supports Most Widely Used Databases

  • DTS can migrate your data to and from most of the widely used commercial and open source databases. It supports homogeneous migrations such as MySQL to MySQL, as well as heterogeneous migrations between different database platforms, such as Oracle to MySQL.

  • Migrations can be from on-premises databases to Amazon RDS or Amazon EC2, databases running on EC2 to RDS, or vice versa, as well as from one RDS database to another RDS database.

  • DTS supports multiple transmission modes, such as data migration, real-time data replication, and change data subscription.

Reliable

  • DTS continually monitors all transmission tasks. In the event of interruption, the task will be restarted and the migration continued from where it was halted.

  • DTS continually monitors the source and target databases, when the connection changes, DTS dynamically modifies the connection in order to optimize performance.

Simple-to-Use

  • You can begin a database migration with just a few clicks from the DTS Management Console.

  • DTS manages all the complexities of the migration process including automatically replicating data changes that occur in the source database during the migration process.

  • You can monitor and manage your tasks in the management console anytime, anywhere.

Product Details

Data Transmission Service (DTS) supports homogenous migrations such as MySQL to MySQL, as well as heterogeneous migration between different data engines, such as Oracle to MySQL. During the migration, the source database remains fully operational, minimizing downtime to applications that rely on the source database.

DTS can be used for continuous data replication with high-availablity. With this solution, customers can perform remote real-time data backup, reducing the latency for remote access, real-time big data analytics initiatives and so forth.
In addition, DTS also can help you subscribe to the change data of ApsaraDB for RDS. With this solution, you can perform message notify, cache refresh and data replication with complicate data processing.

DTS allows you to stream data to Analytic DB from ApsaraDB for RDS in real-time, without degrading the performance of the source production systems.


Features

Data Migration

Zero Downtime

  • All data changes to the source database that occur during the migration are continuously replicated to the target, allowing the source database to be fully operational during the migration process.

  • After completion of the database migration, the target database will remain synchronized with the source for as long as you choose, allowing you to switch over the database at a convenient time.

Supports Most Widely Used Databases

  • DTS supports homogenous migration such as MySQL to MySQL, SQLServer to SQLServer, as well as heterogeneous migration such as Oracle to MySQL.

  • DTS supports heterogeneous migrations between different database platforms. Migrations can be from on-premises databases to ApsaraDB for RDS or Alibaba Cloud ECS, databases running on ECS to RDS, or vice versa, as well as from one RDS database to another RDS database.

Real-Time Data Replication

  • DTS supports real-time data synchronization from one RDS database to another RDS database.

  • You can modify the synchronization object during the synchronization process.

Real-Time Change Data Subscription

  • DTS supports real-time subscribing of change data of RDS.

  • You can modify the subscription object after subscription instance created.

Automatic Monitoring

  • Provides crucial instance information like replication delay, transmission status, and consumption delay in real-time so that you can monitor and protect business critical applications.

Pricing

Data Transmission Service is charged based according to three models: Data Synchronization, Data Subscription and Data Migration

Data migration however only supports on a Pay-As-You-Go payment model, which charges configuration fee and Internet traffic fee. Configuration fees are only charged for normal run time of data replication, and Internet traffic charges temporarily are not charged.


Data Synchronization

Dest RegionInstance SpecificationConfiguration Fee (Annual Price)Configuration Fee (Monthly Price)Configuration Fee (Pay-as-you-go)
Singapore-SingaporemicroUS$1180.8US$118.08US$0.246
Singapore-SingaporesmallUS$1785.6US$178.56US$0.372
Singapore-SingaporemediumUS$2688.0US$268.80US$0.56
Singapore-SingapprelargeUS$4017.6US$401.76US$0.837
Singapore-HongKongmicroUS$8568.0US$856.80US$1.785
Singapore-HongKongsmallUS$12864.0US$1286.40US$2.680
Singapore-HongKongmediumUS$19296.0US$1929.60US$4.020
Singapore-HongKonglargeUS$28939.2US$2893.92US$6.029
Singapore-US EastmicroUS$10286.4US$1028.64US$2.143
Singapore-US EastsmallUS$15432.0US$1543.20US$3.215
Singapore-US EastmediumUS$23150.4US$2315.04US$4.823
Singapore-US EastlargeUS$34728.0US$3472.80US$7.235
Singapore-US WestmicroUS$8568.0US$856.80US$1.785
Singapore-US WestsmallUS$12864.0US$1286.40US$2.680
Singapore-US WestmediumUS$19296.0US$1929.60US$4.020
Singapore-US WestlargeUS$28939.2US$2893.92US$6.029
Singapore-China MainlandmicroUS$8568.0US$856.80US$1.785
Singapore-China MainlandsmallUS$12864.0US$1286.40US$2.680
Singapore-China MainlandmediumUS$19296.0US$1929.60US$4.020
Singapore-China MainlandlargeUS$28939.2US$2893.92US$6.029
Dest RegionInstance SpecificationConfiguration Fee (Annual Price)Configuration Fee (Monthly Price)Configuration Fee (Pay-as-you-go)
HongKong-SingaporemicroUS$8568.0US$856.80US$1.785
HongKong-SingaporesmallUS$12864.0US$1286.40US$2.680
HongKong-SingaporemediumUS$19296.0US$1929.60US$4.020
HongKong-SingaporelargeUS$28939.2US$2893.92US$6.029
HongKong-HongKongmicroUS$1180.8US$118.08US$0.246
HongKong-HongKongsmallUS$1785.6US$178.56US$0.372
HongKong-HongKongmediumUS$2688.0US$268.80US$0.56
HongKong-HongKonglargeUS$4017.6US$401.76US$0.837
HongKong-US EastmicroUS$8956.8US$895.68US$1.866
HongKong-US EastsmallUS$13440.0US$1344.00US$2.800
HongKong-US EastmediumUS$20160.0US$2016.00US$4.200
HongKong-US EastlargeUS$30240.0US$3024.00US$6.300
HongKong-US WestmicroUS$7459.2US$745.92US$1.554
HongKong-US WestsmallUS$11203.2US$1120.32US$2.334
HongKong-US WestmediumUS$16800.0US$1680.00US$3.500
HongKong-US WestlargeUS$25204.8US$2520.48US$5.251
HongKong-China MainlandmicroUS$6720.0US$672.00US$1.400
HongKong-China MainlandsmallUS$10094.4US$1009.44US$2.103
HongKong-China MainlandmediumUS$15139.2US$1513.92US$3.154
HongKong-China MainlandlargeUS$22708.8US$2270.88US$4.731
Dest RegionInstance SpecificationConfiguration Fee (Annual Price)Configuration Fee (Monthly Price)Configuration Fee (Pay-as-you-go)
US East-SingaporemicroUS$10286.4US$1028.64US$2.143
US East-SingaporesmallUS$15432.0US$1543.20US$3.215
US East-SingaporemediumUS$23150.4US$2315.04US$4.823
US East-SingaporelargeUS$34728.0US$3472.80US$7.235
US East-HongKongmicroUS$8956.8US$895.68US$1.866
US East-HongKongsmallUS$13440.0US$1344.00US$2.800
US East-HongKongmediumUS$20160.0US$2016.00US$4.200
US East-HongKonglargeUS$30240.0US$3024.00US$6.300
US East-US EastmicroUS$1180.8US$118.08US$0.246
US East-US EastsmallUS$1785.6US$178.56US$0.372
US East-US EastmediumUS$2688.0US$268.80US$0.56
US East-US EastlargeUS$4017.6US$401.76US$0.837
US East-US WestmicroUS$2443.2US$244.32US$0.509
US East-US WestsmallUS$3676.8US$367.68US$0.766
US East-US WestmediumUS$5524.8US$552.48US$1.151
US East-US WestlargeUS$8294.4US$829.44US$1.728
US East-China MainlandmicroUS$8956.8US$895.68US$1.866
US East-China MainlandsmallUS$13440.0US$1344.00US$2.800
US East-China MainlandmediumUS$20160.0US$2016.00US$4.200
US East-China MainlandlargeUS$30240.0US$3024.00US$6.300
Dest RegionInstance SpecificationConfiguration Fee (Annual Price)Configuration Fee (Monthly Price)Configuration Fee (Pay-as-you-go)
US West-SingaporemicroUS$8568.0US$856.80US$1.785
US West-SingaporesmallUS$12864.0US$1286.40US$2.680
US West-SingaporemediumUS$19296.0US$1929.60US$4.020
US West-SingaporelargeUS$28939.2US$2893.92US$6.029
US West-HongKongmicroUS$7459.2US$745.92US$1.554
US West-HongKongsmallUS$11203.2US$1120.32US$2.334
US West-HongKongmediumUS$16800.0US$1680.00US$3.500
US West-HongKonglargeUS$25204.8US$2520.48US$5.251
US West-US EastmicroUS$2443.2US$244.32US$0.509
US West-US EastsmallUS$3676.8US$367.68US$0.766
US West-US EastmediumUS$5524.8US$552.48US$1.151
US West-US EastlargeUS$8294.4US$829.44US$1.728
US West-US WestmicroUS$1180.8US$118.08US$0.246
US West-US WestsmallUS$1785.6US$178.56US$0.372
US West-US WestmediumUS$2688.0US$268.80US$0.56
US West-US WestlargeUS$4017.6US$401.76US$0.837
US West-China MainlandmicroUS$7459.2US$745.92US$1.554
US West-China MainlandsmallUS$11203.2US$1120.32US$2.334
US West-China MainlandmediumUS$16800.0US$1680.00US$3.500
US West-China MainlandlargeUS$25204.8US$2520.48US$5.251
Dest RegionInstance SpecificationConfiguration Fee (Annual Price)Configuration Fee (Monthly Price)Configuration Fee (Pay-as-you-go)
China Mainland-SingaporemicroUS$8568.0US$856.80US$1.785
China Mainland-SingaporesmallUS$12864.0US$1286.40US$2.680
China Mainland-SingaporemediumUS$19296.0US$1929.60US$4.020
China Mainland-SingaporelargeUS$28939.2US$2893.92US$6.029
China Mainland-HongKongmicroUS$6720.0US$672.00US$1.400
China Mainland-HongKongsmallUS$10094.4US$1009.44US$2.103
China Mainland-HongKongmediumUS$15139.2US$1513.92US$3.154
China Mainland-HongKonglargeUS$22708.8US$2270.88US$4.731
China Mainland-US EastmicroUS$8956.8US$895.68US$1.866
China Mainland-US EastsmallUS$13440.0US$1344.00US$2.800
China Mainland-US EastmeidumUS$20160.0US$2016.00US$4.200
China Mainland-US EastlargeUS$30240.0US$3024.00US$6.300
China Mainland-US WestmicroUS$7459.2US$745.92US$1.554
China Mainland-US WestsmallUS$11203.2US$1120.32US$2.334
China Mainland-US WestmediumUS$16800.0US$1680.00US$3.500
China Mainland-US WestlargeUS$25204.8US$2520.48US$5.251
Data Synchronization between regions in china mainlandmicroUS$1675.2US$167.52US$0.349
Data Synchronization between regions in china mainlandsmallUS$2524.8US$252.48US$0.526
Data Synchronization between regions in china mainlandmediumUS$3787.2US$378.72US$0.789
Data Synchronization between regions in china mainlandlargeUS$5678.4US$567.84US$1.183
Data synchronization between two instance in the same region in china mainlandmicroUS$1180.8US$118.08US$0.246
data synchronization between two instance in the same region in china mainlandsmallUS$1785.6US$178.56US$0.372
Data synchronization between two instance in the same region in china mainlandmediumUS$2688.0US$268.80US$0.56
Data synchronization between two instance in the same region in china mainlandlargeUS$4017.6US$401.76US$0.837

(1) Payment Method: Pay-As-You-Go and Monthly Subscription
(2) Charging Items: Instance configuration fee
(3) Cross-border data synchronization is not opened for everyone, if you need to use, please submit request to us.


Data Subscription

Instance RegionConfiguration Fee (annual price)Configuration Fee (monthly price)Configuration Fee (Pay-As-You-Go)Data Traffic FeeInternet Traffic Fee
HangzhouUS$1813.50US$181.350US$0.378US$0.154US$0.123
ShanghaiUS$1813.50US$181.350US$0.378US$0.154US$0.123
QingdaoUS$1813.50US$181.350US$0.378US$0.154US$0.123
BeijingUS$1813.50US$181.350US$0.378US$0.154US$0.123
ShenzhenUS$1813.50US$181.350US$0.378US$0.154US$0.123
Hong KongUS$2261.50US$226.150US$0.470US$0.154US$0.153
SingaporeUS$3489.20US$348.920US$0.730US$0.154US$0.081
US EastUS$3553.80US$355.380US$0.740US$0.154US$0.077

(1) Payment Mode: Pay-As-You-Go and Monthly Subscription.
(2) Charging Items: Instance configuration fee, data traffic costs, internet traffic fee.
(3) The data traffic fee charged according to the actual amount of data subscribed by the SDK. Data traffic charges are temporarily not charged.
(4) The internet traffic fee is temporarily not charged.


Data Migration

Instance RegionInstance SpecificationConfiguration Fee (Pay-As-You-Go)Internet Traffic Fee
China MainlandSmallUS$0.158US$0.123
China MainlandMediumUS$0.287US$0.123
China MainlandLargeUS$0.462US$0.123
Hong KongSmallUS$0.179US$0.153
Hong KongMediumUS$0.320US$0.153
Hong KongLargeUS$0.517US$0.153
SingaporeSmallUS$0.278US$0.081
SingaporeMediumUS$0.550US$0.081
SingaporeLargeUS$0.955US$0.081
US WestSmallUS$0.162US$0.077
US WestMediumUS$0.320US$0.077
US WestLargeUS$0.646US$0.077

(1) Instance configuration fee: Only the normal run time of data replication charged. The run time of migrating object structure and migrating existing data do not charged.
(2) Internet traffic fee is temporarily not charged.


Scenarios

The following are a few common DTS scenarios:

1) Database Migration With No Downtime

  • Data Transmission Service helps you migrate data with virtually no downtime. All data changes to the source database that occur during the migration are continuously replicated to the target, allowing the source database to be fully operational during the migration process. After the database migration is complete, the target database will remain synchronized with the source for as long as you choose, allowing you to switchover the database at a convenient time.

Recommended Configuration

Zero downtime migration

2) Remote Data Disaster Recovery

  • With DTS, you can perform real-time data replication between two RDS instance in deferent regions. The remote disaster recovery instance is a slave of the primary instance. When disaster occur, applications can switch to the remote disaster recovery instance from the primary instance to guarantee business availability.

Recommended Configuration

Off-site disaster preparation

3) Decrease Remote Access

  • When an application deploys in a single region, user access from other regions will suffer access latency and poor user experience. To improve access experience, you utilize use the recommended architecture as follows:

Recommended Configuration

Avoid cross-regional access
  • This architecture consists of a center and units. Write requests of users in all regions are routed back to the center. Data in the center is synchronized to units via DTS. Read requests of users in different regions may be routed to the nearby units so as to avoid remote access, and reduce access latency.

4) Real-time Big Data Analytics

  • DTS provides optimized and high performance delivery to Analytic DB from RDS to support customers with their real-time big data analytics initiatives. With this solution, customers can perform ad-hoc discovery, organization, and enrichment of low-latency data before it traverses to more refined sets of analytics tools.

Recommended Configuration

Online to offline real-time data channel

5) Cache Refresh

  • In order to support high-speed access to data, you may use caching services with RDS. With data subscription of DTS, you can perform low latency cache refresh, without degrading the performance of the RDS instance.

Recommended Configuration

Cache update
  • DTS can subscribe to change data of the RDS instance in real-time. It can also refresh cached data when data of RDS is changed.

6) Message Notify

  • When two applications have asynchronous coupling, you can use data subscription of DTS to perform low latency message notification without degrading the performance of the source application. With data subscription, you don’t have to publish messages during the source application. With this solution, you can therefore make the core application more stable and reliable.

Recommended Configuration

Notification

Getting Started

Quickly create and manage your DTS instances from the DTS Management Console.

Using DTS via the Management Console

Alibaba Cloud Management Console provides a simple Web-based user interface that allows you to create and manage your data transmission task.

Using the Console, you can create, modify, and manage data transmission tasks. Change the class of the used resources and monitor the data transmission tasks.

For a step-by-step overview on how to manage and operate your DTS instance through the Management Console, read the Quick Start

Access DTS Product Documentation

DTS product documentation walks you through the product architecture, implementation principle, and detailed user guide.

To create your own DTS instance, read the DTS Documentation to get a detailed understanding of how DTS works and how to modify and manage your DTS instance. The documentation will also help you understand best practices in using DTS.

Resources

The links below will take you to SDKs and important documentation. These links will help developers integrate RDS with their existing applications.

FAQs

1. Does DTS support data migration between RDS instances under two different Alibaba Cloud accounts?

Yes. When migrating data between RDS instances under different Alibaba Cloud accounts, you need to login DTS console with the account of the target RDS instance.
When configuring the migration task, you need to select on-permit databases with public IP addresses for the source instance,and configure the connection of the source RDS instance.

2. Does DTS support migrating the change data of the source instance during data migration?

Yes. All data changes to the source database that occur during the migration are continuously replicated to the target. DTS allows the source database to be fully operational during the migration process.

3. What are the basic principles of change data migration through DTS?

The basic principles of change data migration through DTS are described below:
During data migration, DTS starts the log parsing module to capture and parse the change logs of the source database in real-time. Then, DTS starts migrating the existing data. After data loading, DTS replicates the captured change data to the target instance, and the target database will remain synchronized with the source for as long as you choose.

4. Are tables locked during data migration through DTS?

When you choose migration existing data and replication change data, during the full data migration, DTS checks whether the source database contains any non-transactional tables having no primary keys (for example, MyISAM). If such tables exist, DTS places read-only locks on the tables to ensure data migration consistency. In other cases, DTS does not place locks on source databases.

5. Which network (intranet or Internet) is used to access ECS instance during data migration through DTS?

If the network type of the ECS instance is VPC, DTS connects to the ECS instance via the Internet.
If the ECS instance is the source instance of the migration task and is located in a region different from the target instance of the migration task, DTS connect to the ECS via Internet.
Otherwise, DTS connects to the ECS instance via an intranet.

6. Which network (intranet or Internet) is used to access the RDS instance during data migration through DTS?

If the RDS instance is the source instance of the migration task and is located in a region different from the target instance of the migration task, DTS connects to the RDS instance via the Internet.
Otherwise, DTS connects to the RDS instance via Intranet.

7. If the RDS instance is the source instance of the migration task and is located in a region different from the target instance of the migration task, DTS can connect to the RDS instance via Internet.<br/> Otherwise, DTS connects to the RDS instance via an Intranet.

If database type of the source instance is MySQL or MongoDB,then the DDL operation will be synchronized.
Otherwise,the DDL operation will not be synchronized.

8. Does DTS support migrating the database on a VPC ECS instance to an RDS instance?

Yes, but the ECS instance must be attached with an EIP address. When configuring the migration task, select the ECS instance for the source instance. DTS accesses the ECS instance via the EIP address of the ECS instance.

9. From which database (active/standby) does DTS capture data during data migration?

DTS captures data from the active database of the RDS instance during data migration.

10. Can DTS migrate the database C in the RDS instance A to the database D in the RDS instance B?

Yes. DTS supports database name mapping which allows data migration between two different databases in two RDS instances.

11. Is the data in the source database deleted after migration through DTS?

No. DTS only copies data in the source database during data migration, and thus the data in the source database is not affected.

12. Why have I received the following error: "Failed to obtain the structure object "[java.sql.SQLException: Io exception: The Network Adapter co" reported?

If such error is reported, DTS fails to connect to the source database. Possible causes include:
(1) The connection address is incorrect.
(2) The firewall is enabled for the local database.
(3) Remote listening is not enabled for the database.

13. What is the table "increment_trx" generated in the target database during data migration?

The table "increment_trx" is created by DTS. It is mainly used to record the checkpoint of migration. When the task is interrupt, DTS automatically restarts the process and continues the migration from the checkpoint recorded.
Do not drop the table; otherwise, the migration task fails.

14. Why is the size of the target RDS instance larger than the source database after migration through DTS.

DTS migrates data through SQL. It will generate binlog in the target instance. Therefore, the size of the target RDS instance after migration is larger than the source database.

15. Why have I received the following error: "java.sql.BatchUpdateException: INSERT, DELETE command denied to user 'user'"?

The general cause is that the target RDS instance is locked, and the write privilege of the account is revoked.
To resolve the problem, you should upgrade the space of the target RDS instance, and restart the task on the DTS Console.

16. Does the data within the tables of the target database overwritten during data migration through DTS?

No. The table of the target instance to be migrated needs to be empty before data migration. If the table to be migrated already exists in the target database, the precheck will fail.

17. How can I migrate a database to the RDS instance from another Alibaba Cloud account.

You will need to login to the DTS Console from the Alibaba Cloud account of the target RDS instance. Set the source instance type to on-permit database, and configure the connection of the source RDS instance.

18. Does the release of a finished migration task affect the use of the migrated database?

No.

19. Can DTS support the synchronization between on_permit database and the RDS instance?

Yes. You can use DTS to perform synchronization between the cloud instance and the on-permit database.

20. Which network (intranet or Internet) is used during data DTS synchronization?

DTS transfers data via intranet during data synchronization.

21. Why is it that my data subscription SDK cannot subscribe to any message and the prompt "client partition is empty, wait partition balance" is always reported?

Why my data subscription SDK cannot subscribe to any message and the prompt "client partition is empty, wait partition balance" is always reported.

22. Why is "keep alive error" reported at the data subscription SDK?

The consumption timestamp is not in the data range of the data subscription instance. You need to modify the consumption timestamp and restart the SDK.

23. Why does the system report an error<br/> "failed to get master store addr for topic aliyun_sz_ecs_ApsaraDBr*****y-1-0" when I use the data subscription function?

Firstly, check whether the sePublicIp in SDK is set to true.
If usePublicIp = true, check whether the consumption timestamp is within the data range of the subscription instance. If not, modify the consumption timestamp and restart the SDK.

24. Why does the system report an error <br/> "Specified signature is not matched with our calculation. at com.aliyuncs.DefaultAcsClient.parseAcsResponse(DefaultAcsClient.java:139) at" when I start the SDK for data subscription?

The Access Key/Access Secret configured in the SDK does not belong to the Alibaba Cloud account corresponding to the subscription instance. Modify Access Key/Access Secret and restart the SDK.

25. Can an SDK client subscribe to multiple channels?

No.

26.Why does the system report "get guid info failed" when I start SDK subscription?

The subscription instance ID set in the SDK is incorrect. You need to replace the "subscription instance ID in the sample code client with the ID of the subscription instance to which you want to subscribe.