All Products
Search
Document Center

Data Transmission Service:Precautions and limits for synchronizing data from a PolarDB-X 1.0 instance

Last Updated:Aug 06, 2025

This topic describes the precautions and limits for synchronizing data from a PolarDB-X 1.0 instance. To ensure that your data synchronization task runs as expected, review these precautions and limits before you configure the task.

Important

For more information about the limits for using PolarDB-X as a source instance, see Limits for using PolarDB-X as the source instance.

For more information about solutions for using PolarDB-X as a source instance, see Solutions for using PolarDB-X as the source instance.

Scenarios of synchronizing data from a PolarDB-X 1.0 instance

Note the precautions and limits in the following data synchronization scenarios:

Note

By default, Data Transmission Service (DTS) disables foreign key constraints on the destination database in a data synchronization task. Therefore, cascade and delete operations in the source database are not synchronized to the following destination database types:

  • PolarDB-X 1.0

  • MySQL (RDS for MySQL and self-managed MySQL)

  • PolarDB for MySQL

  • AnalyticDB for MySQL

Synchronize data between PolarDB-X 1.0 instances

Category

Description

Limits on the source database

  • The tables to be synchronized must have PRIMARY KEY or UNIQUE constraints (tables that have only UNIQUE constraints do not support schema synchronization, so we recommend that you use PRIMARY KEY constraints), and the fields must be unique. Otherwise, the destination database may contain duplicate data. Tables that have secondary indexes cannot be synchronized.

  • If you select tables as the objects to be synchronized and you want to edit the tables, such as mapping table or column names, you can synchronize up to 5,000 tables in a single data synchronization task. If you run a task to synchronize more than 5,000 tables, a request error may occur after you submit the task. In this case, we recommend that you split the tables to be synchronized and configure multiple tasks to synchronize the tables in batches, or configure a task to synchronize the entire database.

  • The following requirements for binary logs of the RDS for MySQL instances attached to the PolarDB-X 1.0 instance must be met:

    • The binary logging feature must be enabled, and the binlog_row_image parameter must be set to full. Otherwise, an error is reported during the precheck, and the data synchronization task cannot be started.

    • For an incremental synchronization task, DTS requires that the binary logs of the source database be retained for at least 24 hours. For a task that performs both full and incremental synchronization, DTS requires that the binary logs of the source database be retained for at least seven days. You can set the retention period of binary logs to more than 24 hours after the initial full data synchronization is complete. Otherwise, DTS may fail to obtain the binary logs and the task may fail. In exceptional circumstances, data may be inconsistent or lost. Issues that are caused because the retention period of binary logs is shorter than the required period are not covered by the DTS Service-Level Agreement (SLA).

  • Limits on operations to be performed on the source database:

    • If you change the network type of the PolarDB-X 1.0 instance during data synchronization, you must modify the network connectivity information of the synchronization link after the network type is changed.

    • During data synchronization, do not scale the source instance, such as scaling the attached RDS for MySQL instance or changing the distribution of physical databases and tables that correspond to logical databases and tables in the RDS for MySQL instance even if the RDS for MySQL instance is not scaled. In addition, do not migrate hot spot tables, change shard keys, or perform DDL operations. Otherwise, the data synchronization task fails or data inconsistency occurs.

    • During full data synchronization, do not perform DDL operations to change the schemas of databases or tables. Otherwise, the data synchronization task fails.

  • The version of the source PolarDB-X 1.0 instance must be 5.2 or later.

Other limits

  • DTS ensures the data consistency of incremental synchronization tasks based on the continuity of XA transactions in the source PolarDB-X 1.0 instance. If the continuity of XA transactions is disrupted, for example, when you modify the synchronization objects or in disaster recovery scenarios for the incremental data collection module, uncommitted XA transactions may be lost.

  • The storage class of the PolarDB-X 1.0 instance must be RDS for MySQL, including private custom RDS and separately purchased RDS. PolarDB for MySQL is not supported as the storage class.

  • Read-only instances of PolarDB-X 1.0 computing resources are not supported.

  • Storage resources of PolarDB-X 1.0 can be split only using horizontal splitting (sharding). Vertical splitting is not supported.

  • A data synchronization task for a PolarDB-X 1.0 instance is a distributed task. A subtask is created for each attached RDS for MySQL instance. You can view the running status of subtasks in the Task Topology.

  • Before you synchronize data, you must evaluate the performance of the source and destination databases. We recommend that you synchronize data during off-peak hours. Otherwise, initial full data synchronization may consume read and write resources of the source and destination databases and increase database loads.

  • During initial full data synchronization, concurrent INSERT operations cause fragmentation in the tables of the destination database. Therefore, after initial full data synchronization is complete, the tablespace of the destination instance is larger than that of the source instance.

  • Do not use tools such as pt-online-schema-change to perform online DDL operations on the synchronization objects in the source database. Otherwise, the synchronization fails.

  • During data synchronization, do not write data to the destination database using other tools. Otherwise, data inconsistency between the source and destination databases occurs. For example, if you use DMS to perform online DDL operations when data is written to the destination database using other tools, data may be lost in the destination database.

  • If a DTS task fails to run, DTS technical support will try to restore the task within 8 hours. During the restoration, the task may be restarted, and the parameters of the task may be modified.

    Note

    Only the parameters of the DTS task may be modified. The parameters of databases are not modified. The parameters that may be modified include but are not limited to the parameters in the "Modify instance parameters" section of the Modify the parameters of a DTS instance topic.

Synchronize data from a PolarDB-X 1.0 instance to a MySQL database or PolarDB for MySQL cluster

Category

Description

Limits on the source database

  • The tables to be synchronized must have PRIMARY KEY or UNIQUE constraints (tables that have only UNIQUE constraints do not support schema synchronization, so we recommend that you use PRIMARY KEY constraints), and the fields must be unique. Otherwise, the destination database may contain duplicate data. Tables that have secondary indexes cannot be synchronized.

  • If you select tables as the objects to be synchronized and you want to edit the tables, such as mapping table or column names, you can synchronize up to 5,000 tables in a single data synchronization task. If you run a task to synchronize more than 5,000 tables, a request error may occur after you submit the task. In this case, we recommend that you split the tables to be synchronized and configure multiple tasks to synchronize the tables in batches, or configure a task to synchronize the entire database.

  • The following requirements for binary logs of the RDS for MySQL instances attached to the PolarDB-X 1.0 instance must be met:

    • The binary logging feature must be enabled, and the binlog_row_image parameter must be set to full. Otherwise, an error is reported during the precheck, and the data synchronization task cannot be started.

    • For an incremental synchronization task, DTS requires that the binary logs of the source database be retained for at least 24 hours. For a task that performs both full and incremental synchronization, DTS requires that the binary logs of the source database be retained for at least seven days. You can set the retention period of binary logs to more than 24 hours after the initial full data synchronization is complete. Otherwise, DTS may fail to obtain the binary logs and the task may fail. In exceptional circumstances, data may be inconsistent or lost. Issues that are caused because the retention period of binary logs is shorter than the required period are not covered by the DTS Service-Level Agreement (SLA).

  • Limits on operations to be performed on the source database:

    • If you change the network type of the PolarDB-X 1.0 instance during data synchronization, you must modify the network connectivity information of the synchronization link after the network type is changed.

    • During data synchronization, do not scale the source instance, such as scaling the attached RDS for MySQL instance or changing the distribution of physical databases and tables that correspond to logical databases and tables in the RDS for MySQL instance even if the RDS for MySQL instance is not scaled. In addition, do not migrate hot spot tables, change shard keys, or perform DDL operations. Otherwise, the data synchronization task fails or data inconsistency occurs.

    • During schema synchronization and full data synchronization, do not execute DDL statements to change the schemas of databases or tables. Otherwise, the data synchronization task fails.

  • The storage class of the PolarDB-X 1.0 instance must be RDS for MySQL, including private custom RDS and separately purchased RDS. PolarDB for MySQL is not supported as the storage class.

  • Storage resources of PolarDB-X 1.0 can be split only using horizontal splitting (sharding). Vertical splitting is not supported.

  • Read-only instances of PolarDB-X 1.0 computing resources are not supported.

  • The version of the source PolarDB-X 1.0 instance must be 5.2 or later.

Other limits

  • Indexes and partitions are not synchronized.

  • DTS ensures the data consistency of incremental synchronization tasks based on the continuity of XA transactions in the source PolarDB-X 1.0 instance. If the continuity of XA transactions is disrupted, for example, when you modify the synchronization objects or in disaster recovery scenarios for the incremental data collection module, uncommitted XA transactions may be lost.

  • A data synchronization task for a PolarDB-X 1.0 instance is a distributed task. A subtask is created for each attached RDS for MySQL instance. You can view the running status of subtasks in the Task Topology.

  • If the data to be synchronized contains information such as rare characters or emojis that takes up four bytes, the destination databases and tables to receive the data must use UTF8mb4 character set.

    Note

    If you use the schema synchronization feature of DTS, set the instance parameter character_set_server in the destination database to UTF8mb4 character set.

  • Before you synchronize data, you must evaluate the performance of the source and destination databases. We recommend that you synchronize data during off-peak hours. Otherwise, initial full data synchronization may consume read and write resources of the source and destination databases and increase database loads.

  • During initial full data synchronization, concurrent INSERT operations cause fragmentation in the tables of the destination database. Therefore, after initial full data synchronization is complete, the tablespace of the destination instance is larger than that of the source instance.

  • Do not use tools such as pt-online-schema-change to perform online DDL operations on the synchronization objects in the source database. Otherwise, the synchronization fails.

  • During data synchronization, do not write data to the destination database using other tools. Otherwise, data inconsistency between the source and destination databases occurs. For example, if you use DMS to perform online DDL operations when data is written to the destination database using other tools, data may be lost in the destination database.

  • Column names in MySQL databases are not case-sensitive. Therefore, if multiple columns in the source database have names that differ only in capitalization, data in the columns are written to the same column in the destination MySQL database during the synchronization. This can cause unexpected synchronization results.

  • After data synchronization is complete, that is, the Status of the instance changes to Completed, we recommend that you run the analyze table <Table name> command to check whether data is written to the destination table. For example, if a high-availability (HA) switchover is triggered in the source MySQL database, data may be written only to the memory. As a result, data loss occurs.

  • If a DTS task fails to run, DTS technical support will try to restore the task within 8 hours. During the restoration, the task may be restarted, and the parameters of the task may be modified.

    Note

    Only the parameters of the DTS task may be modified. The parameters of databases are not modified. The parameters that may be modified include but are not limited to the parameters in the "Modify instance parameters" section of the Modify the parameters of a DTS instance topic.

Synchronize data from a PolarDB-X 1.0 instance to an AnalyticDB for MySQL cluster

Category

Description

Limits on the source database

  • The tables to be synchronized must have PRIMARY KEY or UNIQUE constraints (tables that have only UNIQUE constraints do not support schema synchronization, so we recommend that you use PRIMARY KEY constraints), and the fields must be unique. Otherwise, the destination database may contain duplicate data. Tables that have secondary indexes cannot be synchronized.

  • If you select tables as the objects to be synchronized and you want to edit the tables, such as mapping table or column names, you can synchronize up to 5,000 tables in a single data synchronization task. If you run a task to synchronize more than 5,000 tables, a request error may occur after you submit the task. In this case, we recommend that you split the tables to be synchronized and configure multiple tasks to synchronize the tables in batches, or configure a task to synchronize the entire database.

  • The following requirements for binary logs of the RDS for MySQL instances attached to the PolarDB-X 1.0 instance must be met:

    • The binary logging feature must be enabled, and the binlog_row_image parameter must be set to full. Otherwise, an error is reported during the precheck, and the data synchronization task cannot be started.

    • For an incremental synchronization task, DTS requires that the binary logs of the source database be retained for at least 24 hours. For a task that performs both full and incremental synchronization, DTS requires that the binary logs of the source database be retained for at least seven days. You can set the retention period of binary logs to more than 24 hours after the initial full data synchronization is complete. Otherwise, DTS may fail to obtain the binary logs and the task may fail. In exceptional circumstances, data may be inconsistent or lost. Issues that are caused because the retention period of binary logs is shorter than the required period are not covered by the DTS Service-Level Agreement (SLA).

  • Limits on operations to be performed on the source database:

    • If you change the network type of the PolarDB-X 1.0 instance during data synchronization, you must modify the network connectivity information of the synchronization link after the network type is changed.

    • During data synchronization, do not scale the source instance, such as scaling the attached RDS for MySQL instance or changing the distribution of physical databases and tables that correspond to logical databases and tables in the RDS for MySQL instance even if the RDS for MySQL instance is not scaled. In addition, do not migrate hot spot tables, change shard keys, or perform DDL operations. Otherwise, the data synchronization task fails or data inconsistency occurs.

    • During schema synchronization and full data synchronization, do not execute DDL statements to change the schemas of databases or tables. Otherwise, the data synchronization task fails.

  • The storage class of the PolarDB-X 1.0 instance must be RDS for MySQL, including private custom RDS and separately purchased RDS. PolarDB for MySQL is not supported as the storage class.

  • Storage resources of PolarDB-X 1.0 can be split only using horizontal splitting (sharding). Vertical splitting is not supported.

  • Read-only instances of PolarDB-X 1.0 computing resources are not supported.

  • The version of the source PolarDB-X 1.0 instance must be 5.2 or later.

Other limits

  • Indexes, partitions, views, procedures, functions, triggers, and foreign key constraints (FKs) are not synchronized.

  • Indexes, partitions, views, procedures, functions, triggers, and foreign keys cannot be synchronized.

  • DTS ensures the data consistency of incremental synchronization tasks based on the continuity of XA transactions in the source PolarDB-X 1.0 instance. If the continuity of XA transactions is disrupted, for example, when you modify the synchronization objects or in disaster recovery scenarios for the incremental data collection module, uncommitted XA transactions may be lost.

  • A data synchronization task for a PolarDB-X 1.0 instance is a distributed task. A subtask is created for each attached RDS for MySQL instance. You can view the running status of subtasks in the Task Topology.

  • If the destination AnalyticDB for MySQL V3.0 cluster is being backed up while the DTS task is running, the DTS task fails.

  • Before you synchronize data, you must evaluate the performance of the source and destination databases. We recommend that you synchronize data during off-peak hours. Otherwise, initial full data synchronization may consume read and write resources of the source and destination databases and increase database loads.

  • During initial full data synchronization, concurrent INSERT operations cause fragmentation in the tables of the destination database. Therefore, after initial full data synchronization is complete, the tablespace of the destination instance is larger than that of the source instance.

  • Do not use tools such as pt-online-schema-change to perform online DDL operations on the synchronization objects in the source database. Otherwise, the synchronization fails.

  • During data synchronization, do not write data to the destination database using other tools. Otherwise, data inconsistency between the source and destination databases occurs. For example, if you use DMS to perform online DDL operations when data is written to the destination database using other tools, data may be lost in the destination database.

  • If a DTS task fails to run, DTS technical support will try to restore the task within 8 hours. During the restoration, the task may be restarted, and the parameters of the task may be modified.

    Note

    Only the parameters of the DTS task may be modified. The parameters of databases are not modified. The parameters that may be modified include but are not limited to the parameters in the "Modify instance parameters" section of the Modify the parameters of a DTS instance topic.

Synchronize data from a PolarDB-X 1.0 instance to a DataHub project

Category

Description

Limits on the source database

  • The tables to be synchronized must have PRIMARY KEY or UNIQUE constraints (tables that have only UNIQUE constraints do not support schema synchronization, so we recommend that you use PRIMARY KEY constraints), and the fields must be unique. Otherwise, the destination database may contain duplicate data. Tables that have secondary indexes cannot be synchronized.

  • If you select tables as the objects to be synchronized and you want to edit the tables, such as mapping table or column names, you can synchronize up to 5,000 tables in a single data synchronization task. If you run a task to synchronize more than 5,000 tables, a request error may occur after you submit the task. In this case, we recommend that you split the tables to be synchronized and configure multiple tasks to synchronize the tables in batches, or configure a task to synchronize the entire database.

  • The following requirements for binary logs of the RDS for MySQL instances attached to the PolarDB-X 1.0 instance must be met:

    • The binary logging feature must be enabled, and the binlog_row_image parameter must be set to full. Otherwise, an error is reported during the precheck, and the data synchronization task cannot be started.

    • If the task includes incremental synchronization, DTS requires that the binary logs of the source database be retained for at least 24 hours. We recommend that you retain the binary logs for seven days. Otherwise, DTS may fail to obtain the binary logs and the task may fail. In exceptional circumstances, data may be inconsistent or lost. Issues that are caused because the retention period of binary logs is shorter than the required period are not covered by the DTS Service-Level Agreement (SLA).

  • Limits on operations to be performed on the source database:

    • If you change the network type of the PolarDB-X 1.0 instance during data synchronization, you must modify the network connectivity information of the synchronization link after the network type is changed.

    • During data synchronization, do not scale the source instance, such as scaling the attached RDS for MySQL instance or changing the distribution of physical databases and tables that correspond to logical databases and tables in the RDS for MySQL instance even if the RDS for MySQL instance is not scaled. In addition, do not migrate hot spot tables, change shard keys, or perform DDL operations. Otherwise, the data synchronization task fails or data inconsistency occurs.

    • During schema synchronization, do not perform DDL operations to change the schemas of databases or tables. Otherwise, the data synchronization task fails.

  • The storage class of the PolarDB-X 1.0 instance must be RDS for MySQL, including private custom RDS and separately purchased RDS. PolarDB for MySQL is not supported as the storage class.

  • Storage resources of PolarDB-X 1.0 can be split only using horizontal splitting (sharding). Vertical splitting is not supported.

  • Read-only instances of PolarDB-X 1.0 computing resources are not supported.

  • The version of the source PolarDB-X 1.0 instance must be 5.2 or later.

Other limits

  • Only incremental synchronization and schema synchronization are supported. Initial full data synchronization is not supported.

  • A single String field in the destination DataHub project cannot exceed 2 MB in length.

  • Limits on the synchronization objects:

    • Only table-level data synchronization is supported.

    • DTS does not synchronize data of the columns that are added to the source table after the data synchronization task is started to the destination DataHub instance.

  • DTS ensures the data consistency of incremental synchronization tasks based on the continuity of XA transactions in the source PolarDB-X 1.0 instance. If the continuity of XA transactions is disrupted, for example, when you modify the synchronization objects or in disaster recovery scenarios for the incremental data collection module, uncommitted XA transactions may be lost.

  • A data synchronization task for a PolarDB-X 1.0 instance is a distributed task. A subtask is created for each attached RDS for MySQL instance. You can view the running status of subtasks in the Task Topology.

  • Before you synchronize data, you must evaluate the performance of the source and destination databases. We recommend that you synchronize data during off-peak hours. Otherwise, the database load may increase.

  • Do not use tools such as pt-online-schema-change to perform online DDL operations on the synchronization objects in the source database. Otherwise, the synchronization fails.

  • During data synchronization, do not write data to the destination database using other tools. Otherwise, data inconsistency between the source and destination databases occurs. For example, if you use DMS to perform online DDL operations when data is written to the destination database using other tools, data may be lost in the destination database.

  • If a DTS task fails to run, DTS technical support will try to restore the task within 8 hours. During the restoration, the task may be restarted, and the parameters of the task may be modified.

    Note

    Only the parameters of the DTS task may be modified. The parameters of databases are not modified. The parameters that may be modified include but are not limited to the parameters in the "Modify instance parameters" section of the Modify the parameters of a DTS instance topic.