Data Transmission Service:FAQ

FAQ types

FAQ are classified into the following types:

• FAQ about billing

• FAQ about performance and instance types

• FAQ about prechecks

  For more information about prechecks, see Precheck and troubleshooting.

• FAQ about database connections

• FAQ about data synchronization

• FAQ about data migration

• FAQ about change tracking

• Others

FAQ about billing

How am I charged for DTS?

You are charged for DTS based on the subscription and pay-as-you-go billing methods. For more information about billing methods, see Billing overview.

How do I view the bills of DTS?

For more information about how to view the bills of DTS, see View bills.

Am I still charged during the period in which a DTS instance is paused?

You are not charged during the period in which a data migration instance is paused. You are still charged during the period in which a data synchronization instance is paused if Incremental Data Synchronization is selected when you configure the data synchronization task. This is because DTS only stops writing data to the destination database and continues to collect data on incremental changes in the source database.

Why is the price of data synchronization higher than that of data migration?

Data synchronization comes with more advanced features. For example, you can reselect the objects to be synchronized, and configure two-way synchronization between MySQL databases. In addition, data synchronization ensures low network latency by transmitting data over an internal network.

What is the impact of overdue payments?

For more information about the impact of overdue payments, see Expiration and overdue payments.

How do I release a subscription instance before it expires?

You can release your subscription instance after you change the billing method of the instance from subscription to pay-as-you-go. For more information about how to change the billing method, see Change the billing method.

Am I able to change the billing method of a task from subscription to pay-as-you-go?

Yes, you can change the billing method of a task from subscription to pay-as-you-go. For more information about how to change the billing method, see Change the billing method.

Am I able to change the billing method of a task from pay-as-you-go to subscription?

Why am I charged for a DTS instance that was previously free?

This is because the free trial period of your DTS instance elapses. DTS provides a free trial period for a task whose destination database is an ApsaraDB database. You are charged for the task after the free trial period elapses.

Why am I still charged for a DTS instance that has been released?

DTS generates bills on a daily basis for pay-as-you-go DTS instances. You are charged for your DTS instance on the day when the instance is released because DTS is used on that day.

How am I charged for a pay-as-you-go DTS instance?

You are charged for a pay-as-you-go DTS instance only when an incremental task is in progress, including the period in which incremental data synchronization is paused, but excluding the period in which incremental data migration is paused. For more information, see Billing methods.

FAQ about performance and instance types

What are the differences between instance types?

For more information about the differences between instance types, see Specifications of data migration instances and Specifications of data synchronization instances.

Am I able to upgrade a DTS instance?

Am I able to downgrade a DTS instance?

No, DTS does not allow you to downgrade a DTS instance.

How long does it take to synchronize or migrate data?

The amount of time required for DTS tasks cannot be estimated. This is because the transmission performance of DTS is affected by various factors such as the internal payload of DTS, the payload of source and destination databases, the volume of data to be transmitted, whether incremental data migration or synchronization is involved in DTS tasks, and network conditions. If you require high performance, we recommend that you select instance types that provide better performance. For more information about instance types, see Specifications of data migration instances and Specifications of data synchronization instances.

How do I view the performance information of a data migration or data synchronization instance?

For more information about how to view the performance information about an instance, see View the connection status and performance of incremental data migration or View the connection status and performance of data synchronization.

Why am I unable to find a specific DTS instance in the DTS console?

FAQ about prechecks

Why is an alert generated for the check item that is related to the data eviction policy of ApsaraDB for Redis?

If the data eviction policy (maxmemory-policy) of the destination database is not set to noeviction, data inconsistency may occur between the source and destination databases. For more information about data eviction policies, see How does ApsaraDB for Redis evict data by default?

What do I do if the items that are related to binary logs fail to pass the precheck for an incremental data migration task?

Check whether the binary logs of the source database are normal. For more information, see Precheck on the binary logging of the source database.

FAQ about database connections

What do I do if the connection to the source database fails?

Check whether the information and settings of the source database are normal. For more information, see Source database connectivity.

What do I do if the connection to the destination database fails?

Check whether the information and settings of the destination database are normal. For more information, see Destination database connectivity.

How do I migrate or synchronize data from or to database instances that reside in regions not supported by DTS?

• For a data migration task, you can apply for a public endpoint for a database instance, such as an ApsaraDB RDS for MySQL instance. This way, the database instance can be connected by using a public IP address. Then, add the CIDR blocks of DTS servers that reside in a region supported by DTS to the whitelist of the database instance. For more information about the CIDR blocks of DTS servers that need to be added to the whitelist of the database instance, see Add the CIDR blocks of DTS servers to the security settings of on-premises databases.

• For a data synchronization task, you cannot synchronize data from or to database instances in regions that are not supported by DTS because database instances cannot be connected by using a public IP address during data synchronization.

FAQ about data synchronization

What types of databases does DTS support for data synchronization?

DTS supports data synchronization between various data sources, such as relational database management system (RDBMS) databases, NoSQL databases, and online analytical processing (OLAP) databases. For more information about the database instances that DTS supports for data synchronization, see Overview of data synchronization scenarios.

What are the differences between data migration and data synchronization?

The following table describes the differences between data migration and data synchronization.

How does DTS work in data synchronization mode?

For more information about how DTS works in data synchronization mode, see Architecture.

How do I calculate a synchronization latency?

A synchronization latency is the difference between the timestamp of the latest data record synchronized to the destination database and the current timestamp of the source database. Unit: millisecond.

Am I able to modify the objects to be synchronized in a data synchronization task?

Yes, you can modify the objects to be synchronized in a data synchronization task. For more information about how to modify the objects to be synchronized, see Add an object to a data synchronization task and Remove an object from a data synchronization task.

Am I able to add tables to a data synchronization task?

Yes, you can add tables to a data synchronization task. For more information about how to add tables to a data synchronization task, see Add an object to a data synchronization task.

How do I modify the objects such as tables and fields in a data synchronization task in the Running state?

When the full data synchronization phase of a data synchronization task ends, you can modify the objects to be synchronized in the incremental data synchronization phase. For more information about how to modify the objects to be synchronized in a data synchronization task in the Running state, see Add an object to a data synchronization task and Remove an object from a data synchronization task.

Does data inconsistency occur if a data synchronization task is resumed after it is paused for a period of time?

If the source database changes during the suspension of a data synchronization task, data in the source and destination databases may become inconsistent. After you resume the data synchronization task and synchronize incremental data to the destination database, data in the source and destination databases is consistent.

If data in the source database of an incremental data synchronization task is deleted, is the synchronized data in the destination database deleted?

If you do not select delete for the DML operations to be synchronized in the incremental data synchronization task, the data in the destination database is not deleted. Otherwise, the synchronized data in the destination database is deleted.

Is the data of the destination Redis instance overwritten during the synchronization between Redis instances?

Data with the same key is overwritten. The destination database is checked in the precheck phase. If the destination database is not empty, an error message is returned.

Am I able to filter fields or data in a data synchronization task?

Yes, you can filter fields or data in a data synchronization task. You can specify an SQL WHERE condition to filter the data to be synchronized. For more information about how to filter fields or data, see Set filter conditions.

Am I able to convert a data synchronization task to a data migration task?

No, different types of tasks cannot be converted to each other.

Am I able to synchronize only data without synchronizing schemas?

Yes, you can synchronize only data without synchronizing schemas. To do so, do not select Schema Synchronization when you configure a data synchronization task.

What are the possible causes for data inconsistency between the source and destination databases in a data synchronization task?

Am I able to modify the names of the synchronized objects in the destination database in a data synchronization task?

Yes, you can modify the names of the synchronized objects in the destination database when you configure a data synchronization task. For more information about how to modify the names of the synchronized objects in the destination database, see Rename an object to be synchronized.

Am I able to synchronize DML or DDL operations?

Yes, you can synchronize DML and DDL operations between relational databases. The supported DML operations are INSERT, UPDATE, and DELETE. The supported DDL operations are CREATE, DROP, ALTER, RENAME, and TRUNCATE.

Can a read-only database instance be used as the source instance for a data synchronization task?

Am I able to synchronize database shards or table partitions?

Yes, you can synchronize database shards and table partitions. For example, you can synchronize database shards and table partitions from a MySQL database or a PolarDB for MySQL cluster to an AnalyticDB for MySQL cluster. This allows you to merge multiple tables.

Why is the size of data in the destination database smaller than that in the source database after data synchronization is complete?

If the data to be synchronized is filtered or the source database has many table partitions, the size of data in the destination database may be smaller than that in the source database after data synchronization is complete.

Is two-way synchronization supported by a cross-account data synchronization task?

You can configure a two-way synchronization task across Alibaba Cloud accounts only between ApsaraDB RDS for MySQL instances.

Am I able to configure a cross-border two-way synchronization task?

No, you cannot configure a cross-border two-way synchronization task.

When records are added to one database in a two-way synchronization task, these records are not added to the other database. Why does this happen?

This may happen if you do not configure the data synchronization task in the reverse direction. For more information about how to configure the data synchronization task in the reverse direction, see Step 12 to Step 16 in the Configure two-way data synchronization between MySQL instances topic.

Why does the progress of an incremental data synchronization task never reach 100%?

The progress of an incremental data synchronization task cannot reach 100%. If DTS performs incremental data synchronization, DTS continuously synchronizes changes from the source database to the destination database in real time and can only be manually stopped. If real-time incremental synchronization is no longer needed, you can stop the synchronization task in the DTS console.

Why does some data fail to be synchronized in an incremental synchronization task?

If you configure only an incremental synchronization task for a DTS instance, DTS synchronizes only the incremental data after the task is started. The data that is stored in the source database before the task is started is not synchronized to the destination database. We recommend that you select Incremental Data Synchronization, Schema Synchronization, and Full Data Synchronization when you configure a data synchronization task. This ensures data consistency.

Is the performance of the source ApsaraDB RDS database affected when I synchronize full data from the source database?

Does DTS support data synchronization from a MySQL database to an ApsaraDB for ClickHouse cluster?

DTS has discontinued the feature of synchronizing data from a MySQL database to an ApsaraDB for ClickHouse cluster. If you have already purchased a DTS instance to synchronize data from a MySQL database to an ApsaraDB for ClickHouse cluster, the DTS instance is not affected. For more information about this feature, see Synchronize data from an ApsaraDB RDS for MySQL instance to an ApsaraDB for ClickHouse cluster in the documentation of DTS.

Why is the latency not displayed for a data synchronization instance whose source database is a PolarDB-X 1.0 database?

A DTS task whose source database is a PolarDB-X 1.0 database is a distributed task. The metrics that are monitored by DTS exist only in subtasks. Therefore, no latency is displayed for the DTS instance whose source database is a PolarDB-X 1.0 database. You can click the instance ID to go to the instance details page and view the latency of the instance on the Subtask Details tab of the Task Management page.

Why is the error DTS-071001 reported in a multi-table merging task?

The error occurs because you perform online DDL operations on the source database when the multi-table merging task is in progress. You modify objects such as table schemas in the source database, but do not modify the corresponding objects in the destination database.

What do I do if I am unable to configure a whitelist when I configure a task in the DTS console of the previous version?

You can configure tasks in the DTS console of the new version.

What do I do if a data synchronization task fails because a DDL operation is performed on the source database?

You can perform the same DDL operation on the destination database and restart the task. We recommend that you do not use tools such as pt-online-schema-change to perform DDL operations on objects during data synchronization. Otherwise, data synchronization may fail. If you use only DTS to write data to the destination database, you can use Data Management (DMS) to perform online DDL operations on source tables during data synchronization. Alternatively, you can remove the tables that are affected by DDL operations. For more information about how to remove the objects to be synchronized, see Remove an object from a data synchronization task.

What do I do if a data synchronization task fails because a DDL operation is performed on the destination database?

Am I able to resume a data synchronization task after it is released? Can data consistency be ensured if I reconfigure the task?

A data synchronization task cannot be resumed after it is released. When you reconfigure the data synchronization task, if you do not select Full Data Synchronization, the incremental data generated after the task is released and before the new task is started cannot be synchronized to the destination database. In this case, data consistency cannot be ensured. If your business requires high accuracy, you can delete the synchronized data from the destination database and reconfigure the data synchronization task. When you reconfigure the task, select Schema Synchronization and Full Data Synchronization for the Task Stages parameter. By default, Incremental Data Synchronization is selected.

What do I do if the progress of a full data synchronization task remains unchanged for an extended period of time?

If the tables to be synchronized do not contain a primary key, full data synchronization is very slow. We recommend that you define a primary key for each table to be synchronized from the source database before you start the data synchronization task.

Am I able to synchronize only the data that does not exist in the destination table from the source table of the same name?

Yes, you can synchronize only the data that does not exist in the destination table from the source table of the same name. When you configure a DTS task, you can set the Processing Mode of Conflicting Tables parameter to Ignore Errors and Proceed. During full data synchronization, if the source and destination databases have the same schemas, and a data record has the same primary key value as an existing data record in the destination database, this record is not synchronized to the destination database.

How do I configure a data synchronization task across Alibaba Cloud accounts?

You must use the Alibaba Cloud account to which the source instance belongs to configure Resource Access Management (RAM) authorization, and then use the Alibaba Cloud account to which the destination instance belongs to configure a DTS task. For more information, see Configure a DTS task across Alibaba Cloud accounts.

What do I do if I am unable to select a DMS logical database instance?

Make sure that you select the region in which the logical database instance resides. If the issue persists, maybe only one instance exists and the instance is selected by default. In this case, continue to configure other parameters.

Am I able to synchronize functions in a data synchronization task if the source database is an SQL Server database?

No, you cannot synchronize functions in a data synchronization task if the source database is an SQL Server database. If you select tables as the objects to be synchronized, DTS also does not synchronize other objects such as views, triggers, or stored procedures to the destination database.

What do I do if an error is reported in a data synchronization task?

You can refer to Common errors and troubleshooting to view the detailed solution based on the error message.

What do I do if I want to enable the hotspot table merging feature for a data synchronization task?

You can set the trans.hot.merge.enable parameter to true. For more information, see Modify the parameters of a DTS instance.

How do I configure a data synchronization task for a source database that contains a trigger?

If you select a database as the object to be synchronized and the database contains a trigger that updates a table, data inconsistency may occur. For more information about how to configure a data synchronization task for a source database that contains a trigger, see Configure a data synchronization task for a source database that contains a trigger.

Am I able to synchronize a system database such as the sys database?

No, you cannot synchronize a system database such as the sys database.

Am I able to synchronize data from or to the admin or local database in a MongoDB instance?

No, you cannot synchronize data from or to the admin or local database in a MongoDB instance.

When am I able to configure a two-way synchronization task in the reverse direction?

You can configure a two-way synchronization task in the reverse direction only if the incremental synchronization task in the forward direction is not delayed.

Am I able to scale out or scale in the nodes of the source PolarDB-X 1.0 instance in a data synchronization task?

No, you cannot scale out or scale in the nodes of the source PolarDB-X 1.0 instance in a DTS task. If the nodes of the source PolarDB-X 1.0 instance are scaled out or scaled in, you must reconfigure the task.

Is the data synchronized from DTS to Kafka unique?

No, DTS cannot ensure that the data synchronized or migrated to Kafka is unique. This is because the data written to Kafka is appended, and duplicate data may exist when a DTS task is restarted or logs in the source database are repeatedly pulled. DTS ensures the idempotence of data. Data is sorted in order based on the time when data is written, and the latest values of duplicate data are appended at the back.

Am I able to synchronize data from an ApsaraDB RDS for MySQL instance to an AnalyticDB for MySQL cluster?

Yes, you can synchronize data from an ApsaraDB RDS for MySQL instance to an AnalyticDB for MySQL cluster. For more information, see Synchronize data from an ApsaraDB RDS for MySQL instance to an AnalyticDB for MySQL V3.0 cluster.

Why is Full Data Synchronization not displayed when I synchronize data between ApsaraDB for Redis instances?

Incremental Data Synchronization is displayed. If you select this option for data synchronization between ApsaraDB for Redis instances, both full data synchronization and incremental data synchronization are performed.

Can I skip full data synchronization?

Yes, you can skip full data synchronization. After you skip full data synchronization, incremental data synchronization continues. However, an error may occur. We recommend that you do not skip full data synchronization.

Am I able to configure a data synchronization task that automatically starts at the specified point in time?

No, you cannot configure a data synchronization task that automatically starts at the specified point in time.

Are the fragmented spaces in a table synchronized during synchronization?

No, the fragmented spaces in a table are not synchronized.

What items do I need to take note of when I synchronize data from a MySQL 8.0 instance to a MySQL 5.6 instance?

You must create a database in the MySQL 5.6 instance before you start the data synchronization task. To ensure compatibility, the version of the destination instance must be the same as or later than that of the source database. If the version of the destination instance is earlier than that of the source database, database compatibility issues may occur.

Am I able to synchronize accounts from the source database to the destination database?

You can synchronize accounts only between ApsaraDB RDS for MySQL instances.

Am I able to configure a two-way synchronization task across Alibaba Cloud accounts?

You can configure a two-way synchronization task across Alibaba Cloud accounts only between ApsaraDB RDS for MySQL instances.

How do I configure the parameters when the destination database is an ApsaraMQ for Kafka instance?

Configure the parameters based on your business requirements. For more information about how to configure some special parameters, see Configure parameters if the destination instance of a DTS task is a Message Queue for Apache Kafka instance.

FAQ about data migration

Does the migrated data exist in the source database after a data migration task is complete?

Yes, the migrated data exists in the source database after a data migration task is complete. DTS copies data from the source database to the destination database during data migration and synchronization. The data in the source database is not affected.

What types of databases does DTS support for data migration?

DTS supports data migration between various data sources, such as RDBMS databases, NoSQL databases, and OLAP databases. For more information, see Overview of data migration scenarios.

How does DTS work in data migration mode?

For more information about how DTS works in data migration mode, see Architecture.

Am I able to modify the objects to be migrated in a data migration task?

No, you cannot modify the objects to be migrated in a data migration task.

Am I able to add tables to a data migration task?

No, you cannot add tables to a data migration task.

How do I modify the objects such as tables and fields in a data migration task in the Running state?

DTS does not allow you to modify the objects to be migrated in a data migration task.

Does data inconsistency occur if a data migration task is restarted after it is paused for a period of time?

If the source database changes during the suspension of a data migration task, data in the source and destination databases may become inconsistent. After you restart the data migration task and migrate incremental data to the destination database, data in the source and destination databases is consistent.

Am I able to convert a data migration task to a data synchronization task?

No, different types of tasks cannot be converted to each other.

Am I able to migrate only data without migrating schemas?

Yes, you can migrate only data without migrating schemas. To do so, do not select Schema Migration when you configure a data migration task.

What are the possible causes for data inconsistency between the source and destination databases in a data migration task?

Am I able to modify the names of the migrated objects in the destination database in a data migration task?

Yes, you can modify the names of the migrated objects in the destination database when you configure a data migration task. For more information about how to modify the names of the migrated objects in the destination database, see Object name mapping.

Am I able to migrate data within a single database instance?

Yes, you can migrate data within a single database instance. For more information, see Synchronize or migrate data between databases with different names.

Am I able to migrate DML or DDL operations?

Yes, you can migrate DML and DDL operations between relational databases. The supported DML operations are INSERT, UPDATE, and DELETE. The supported DDL operations are CREATE, DROP, ALTER, RENAME, and TRUNCATE.

Can a read-only database instance be used as the source instance for a data migration task?

Am I able to migrate database shards or table partitions?

Yes, you can migrate database shards and table partitions. For example, you can migrate database shards and table partitions from a MySQL database or a PolarDB for MySQL cluster to an AnalyticDB for MySQL cluster. This allows you to merge multiple tables.

Am I able to filter fields or data in a data migration task?

Yes, you can filter fields or data in a data migration task. You can specify an SQL WHERE condition to filter the data to be migrated. For more information about how to filter fields or data, see Filter the data to be migrated.

Why is the size of data in the destination database smaller than that in the source database after data migration is complete?

If the data to be migrated is filtered or the source database has many table partitions, the size of data in the destination database may be smaller than that in the source database after data migration is complete.

Why does the number of migrated objects exceed the total number of objects in a data migration task?

The total number of objects displayed is an estimated value. After the data migration task is complete, the total number is adjusted to an exact value.

Why is the increment_trx table created in the destination database during data migration?

The increment_trx table is an offset table created by DTS in the destination database. This table records the offsets of incremental data migration and can be used to resolve a resumable upload issue if the task is abnormally restarted. Do not delete the increment_trx table during data migration. Otherwise, data migration may fail.

Is resumable upload supported by a data migration task in the full data migration phase?

Yes, you can resume a data migration task from the point at which it is interrupted in the full data migration phase. If a data migration task is restarted after it is paused for a period in the full data migration phase, the task continues to migrate data from the offset where the migration is complete. You do not need to start data migration from the beginning.

How do I migrate data from a third-party database instance to Alibaba Cloud?

For more information about how to migrate data from a database instance that is not provided by Alibaba Cloud to Alibaba Cloud, see Migrate data from a third-party cloud to Alibaba Cloud.

How do I migrate data from an on-premises Oracle database to a PolarDB for Oracle cluster?

For more information about how to migrate data from an on-premises Oracle database to a PolarDB for Oracle cluster, see Migrate data from a self-managed Oracle database to a PolarDB for PostgreSQL (Compatible with Oracle) cluster.

Am I able to pause a data migration task in the full data migration phase before the task is complete?

Yes, you can pause a data migration task in the full data migration phase before the task is complete.

How do I migrate partial data from an ApsaraDB RDS for MySQL instance to a self-managed MySQL database?

When you configure a data migration task, you can select the objects to be migrated in the Source Objects section or filter objects in the Selected Objects section based on your business requirements. The operations to migrate data between MySQL databases are similar. For more information, see Migrate data from a self-managed MySQL database to an ApsaraDB RDS for MySQL instance.

How do I migrate data between ApsaraDB RDS instances within the same Alibaba Cloud account?

DTS supports data migration and synchronization between ApsaraDB RDS instances. For more information, see Overview of data migration scenarios.

After a data migration task is started, an IOPS alert is reported for the source database. How do I ensure the stability of the source database in this case?

Why am I unable to select a database named test for a data migration task?

A system database cannot be migrated. You can select a self-managed database for migration.

Why is the latency not displayed for a data migration instance whose source database is a PolarDB-X 1.0 database?

A DTS task whose source database is a PolarDB-X 1.0 database is a distributed task. The metrics that are monitored by DTS exist only in subtasks. Therefore, no latency is displayed for the DTS instance whose source database is a PolarDB-X 1.0 database. You can click the instance ID to go to the instance details page and view the latency of the instance on the Subtask Details tab of the Task Management page.

Why am I unable to migrate data from a MongoDB instance?

This is because the database to be migrated is the local or admin database. You cannot migrate data from or to the local or admin database in a MongoDB instance.

Why is the error DTS-071001 reported in a multi-table merging task?

The error occurs because you perform online DDL operations on the source database when the multi-table merging task is in progress. You modify objects such as table schemas in the source database, but do not modify the corresponding objects in the destination database.

What do I do if I am unable to configure a whitelist when I configure a task in the DTS console of the previous version?

You can configure tasks in the DTS console of the new version.

What do I do if a data migration task fails because a DDL operation is performed on the source database?

You can perform the same DDL operation on the destination database and restart the task. We recommend that you do not use tools such as pt-online-schema-change to perform online DDL operations on objects during data migration. Otherwise, data migration may fail. If you use only DTS to write data to the destination database, you can use DMS to perform online DDL operations during data migration.

What do I do if a data migration task fails because a DDL operation is performed on the destination database?

If a destination database or a table of the destination database is deleted during incremental data migration, the data migration task fails. You can reconfigure the task and do not select the database or table that causes the task failure as the object to be migrated.

Am I able to resume a data migration task after it is released? Can data consistency be ensured if I reconfigure the task?

A data migration task cannot be resumed after it is released. When you reconfigure the data migration task, if you do not select Full Data Migration, the incremental data generated after the task is released and before the new task is started cannot be migrated to the destination database. In this case, data consistency cannot be ensured. If your business requires high accuracy, you can delete the migrated data from the destination database and reconfigure the data migration task. When you reconfigure the task, select Schema Migration, Incremental Data Migration, and Full Data Migration for the Task Stages parameter.

What do I do if the progress of a full data migration task remains unchanged for an extended period of time?

If the tables to be migrated do not contain a primary key, full data migration is very slow. We recommend that you define a primary key for each table to be migrated from the source database before you start the data migration task.

Am I able to migrate only the data that does not exist in the destination table from the source table of the same name?

Yes, you can migrate only the data that does not exist in the destination table from the source table of the same name. When you configure a DTS task, you can set the Processing Mode of Conflicting Tables parameter to Ignore Errors and Proceed. During full data migration, if the source and destination databases have the same schemas, and a data record has the same primary key value as an existing data record in the destination database, this record is not migrated to the destination database.

How do I configure a data migration task across Alibaba Cloud accounts?

You must use the Alibaba Cloud account to which the source instance belongs to configure Resource Access Management (RAM) authorization, and then use the Alibaba Cloud account to which the destination instance belongs to configure a DTS task. For more information, see Configure a DTS task across Alibaba Cloud accounts.

How do I connect to an on-premises database to migrate data from the on-premises database?

When you configure a data migration task, you can set the Access Method parameter to Public IP Address for your on-premises database. For more information about how to migrate data from an on-premises database, see Migrate data from a self-managed MySQL database to an ApsaraDB RDS for MySQL instance.

What do I do if a data migration task fails and the error DTS-31008 is reported?

You can find the failed task in the DTS console and click View Cause to view details. For more information about the detailed solutions, see Common errors and troubleshooting.

What do I do if the connection to a self-managed database over Express Connect fails?

Check whether the CIDR blocks of DTS servers for connections over Express Connect in the required region are added to the IP address whitelist of the self-managed database. For more information about the CIDR blocks of DTS servers that need to be added to the whitelist of the self-managed database, see Whitelist DTS IP ranges for your user-created database.

Am I able to migrate functions in a data migration task if the source database is an SQL Server database?

No, you cannot migrate functions in a data migration task if the source database is an SQL Server database. If you select tables as the objects to be migrated, DTS also does not migrate other objects such as views, triggers, or stored procedures to the destination database.

What do I do if a full data migration task is run at a low speed?

This is because a large amount of data is to be migrated. Wait until the task is complete. You can log on to the DTS console and click the instance ID to go to the instance details page. On the Task Management page, click the Full Data Migration tab to view the progress of the full data migration task.

What do I do if an error is reported for schema migration?

You can log on to the DTS console and click the instance ID to go to the instance details page. On the Task Management page, click the Schema Migration tab to view the detailed error message and troubleshoot the error. For more information about how to troubleshoot common errors, see Common errors and troubleshooting.

Am I charged for schema migration or full data migration?

No, you are not charged for schema migration or full data migration. For more information, see Billable items.

Is the data of the ZSET type overwritten in the destination instance if I migrate data between ApsaraDB for Redis instances?

Yes, the data of the ZSET type is overwritten in the destination database if you migrate data between ApsaraDB for Redis instances. If the source and destination databases have the same key of the ZSET type, DTS deletes the data of the ZSET key from the destination database, and migrates all the members of the ZSET key from the source database to the destination database by running the ZADD command.

What is the impact of full data migration on the source database?

During full data migration, DTS divides data into slices and reads and writes data within the slicing range. The IOPS of the source database increases during data slicing. When DTS reads data within the slicing range, the IOPS, CachePool, and outbound bandwidth of the source database are affected. Based on the practical experience of DTS, these impacts can be ignored.

Am I able to scale out or scale in the nodes of the source PolarDB-X 1.0 instance in a data migration task?

No, you cannot scale out or scale in the nodes of the source PolarDB-X 1.0 instance in a DTS task. If the nodes of the source PolarDB-X 1.0 instance are scaled out or scaled in, you must reconfigure the task.

Is the data migrated from DTS to Kafka unique?

No, DTS cannot ensure that the data synchronized or migrated to Kafka is unique. This is because the data written to Kafka is appended, and duplicate data may exist when a DTS task is restarted or logs in the source database are repeatedly pulled. DTS ensures the idempotence of data. Data is sorted in order based on the time when data is written, and the latest values of duplicate data are appended at the back.

Does data inconsistency occur if I configure a full data migration task and then configure an incremental data migration task?

Yes, data inconsistency may occur. If you configure an incremental data migration task, data is migrated only after the incremental data migration task is started. Before the task is started, the incremental data that is generated in the source instance is not synchronized to the destination instance. If you need to migrate data without service interruption, select Schema Migration, Full Data Migration, and Incremental Data Migration when you configure a migration task.

Do I need to select Schema Migration when I configure an incremental data migration task?

If you select Schema Migration, DTS migrates the definitions of the objects to be migrated, such as the definition of Table A, to the destination instance before data is migrated. To perform incremental data migration, we recommend that you select Schema Migration, Full Data Migration, and Incremental Data Migration. This ensures data consistency during data migration.

Why is the storage space of the destination RDS instance larger than that of the source database when I migrate data from a self-managed database to an RDS instance?

DTS uses logical migration. DTS encapsulates the data to be migrated into SQL statements and then migrates the SQL statements to the destination RDS instance. In this case, binary logs are generated in the destination RDS instance. Therefore, the storage space of the destination RDS instance may be larger than that of the source database during the migration.

Am I able to select an ApsaraDB for MongoDB instance in a VPC as the source database to migrate data?

Yes, DTS allows you to select an ApsaraDB for MongoDB instance in a VPC as the source database to migrate data.

What is the impact of modifying the data of the source database when a data migration task is in progress?

If Schema Migration, Full Data Migration, and Incremental Data Migration are selected for the data migration task, DTS migrates all data changes from the source database to the destination database.

Is the source database affected if I release a data migration task that is complete?

No, the source database is not affected. After the state of the data migration task changes to Completed, you can release the data migration task.

Does DTS support incremental data migration for an ApsaraDB for MongoDB instance?

Yes, DTS supports incremental data migration for an ApsaraDB for MongoDB instance. For more information, see Overview of data migration scenarios.

What is the difference between a data migration task whose source instance is an RDS instance and a data migration task whose source instance is a self-managed database instance that is connected over a public IP address?

If you select an RDS instance as the source instance, the data migration task can be adaptive to modifications, such as the modifications of Domain Name System (DNS) and network type changes. This ensures instance reliability.

Am I able to migrate data from a self-managed database that is hosted on an ECS instance in a VPC to an RDS instance?

Are tables locked by DTS during data migration? Does it affect the source database?

DTS does not lock tables in the source database during full data migration or incremental data migration. During full data migration and incremental data migration, tables in the source database can be read and written.

Does DTS obtain data from the primary or secondary RDS database when DTS migrates data from an RDS instance?

DTS pulls data from the primary RDS database when DTS migrates data from an RDS instance.

Am I able to configure a data migration task that automatically starts at the specified point in time?

No, you cannot configure a data migration task that automatically starts at the specified point in time.

Am I able to migrate data from an RDS instance in a VPC?

Yes, you can migrate data from an RDS instance in a VPC. Specify the ID of the RDS instance when you configure a data migration task.

During data migration or synchronization within the same Alibaba Cloud account or across Alibaba Cloud accounts, does DTS access an ECS instance or RDS instance over an internal network or the Internet? Am I charged for network traffic?

Is the data in the source database deleted after the data is migrated by using DTS?

No, the data in the source database is not deleted. During the migration, DTS copies the data in the source database to the destination database. This does not affect the data in the source database.

Am I able to specify the name of the destination database when I use DTS to migrate data between RDS instances?

Yes, you can skip full data migration. During the migration, you can use the database name mapping feature that is provided by DTS to specify the name of the destination database. For more information, see Synchronize or migrate data between databases with different names.

What do I do if DTS cannot connect to the source ECS instance in a data migration task?

The public IP address of the ECS instance may be unavailable. Associate an elastic IP address (EIP) with the ECS instance and try again. For more information about how to associate an EIP, see Associate or disassociate an EIP.

Why is Full Data Synchronization not displayed when DTS migrates data between ApsaraDB for Redis instances?

Incremental Data Migration is displayed. If you select this option for data migration between ApsaraDB for Redis instances, both full data migration and incremental data migration are performed.

Can I skip full data migration?

Yes, you can skip full data migration. After you skip full data migration, the incremental data migration continues. However, an error may occur. We recommend that you do not skip full data migration.

Am I able to connect an ApsaraDB for Redis instance of the cluster edition to DTS over a public IP address?

No, you can only connect an ApsaraDB for Redis instance of the standalone edition to DTS over a public IP address.

What items do I need to take note of when I migrate data from a MySQL 8.0 instance to a MySQL 5.6 instance?

You must create a database in the MySQL 5.6 instance before you start the data migration task. To ensure compatibility, make sure that the version of the destination database is the same as or later than that of the source database. If the version of the destination database is earlier than the version of the source database, database compatibility issues may occur.

Am I able to migrate accounts from the source database to the destination database?

You can migrate accounts only between ApsaraDB RDS for MySQL instances.

How do I configure the parameters when the destination database is an ApsaraMQ for Kafka instance?

Configure the parameters based on your business requirements. For more information about how to configure some special parameters, see Configure parameters if the destination instance of a DTS task is a Message Queue for Apache Kafka instance.

FAQ about change tracking

How does DTS work in change tracking mode?

For more information about how DTS works in change tracking mode, see Architecture.

Are consumer groups deleted after a change tracking instance expires?

After a change tracking instance expires, relevant consumer groups are retained for seven days. If the instance is not renewed within seven days after expiration, it is released, and relevant consumer groups are also deleted.

Can a read-only database instance be used as the source instance for a change tracking task?

How do I consume tracked data?

For more information about how to consume tracked data, see Consume tracked data.

Why is the date format changed after data is transmitted by using the change tracking feature?

By default, a date is stored in the YYYY:MM:DD format but displayed in the YYYY-MM-DD format in DTS. Therefore, all dates are stored and displayed in the default formats in DTS regardless of the original formats in which the dates are transmitted and written.

How do I troubleshoot the issues of change tracking tasks?

For more information about how to troubleshoot the issues of change tracking tasks, see Troubleshoot issues with change tracking tasks.

What do I do if the SDK client is suddenly suspended during data download and cannot track data changes?

Check whether the ackAsConsumed method is called in the SDK code to report a consumer offset. If the ackAsConsumed method is not called to report a consumer offset, data in the cache cannot be cleared. The SDK fails to pull data after the cache is fully occupied. In this case, the SDK is suspended and cannot track data changes.

What do I do if I cannot track data changes after the SDK client is restarted?

Before you start the SDK client, you need to modify the consumer offset to be within the time range of all tracked data changes. For more information, see the "Manage consumer offsets" section of the Use the SDK demo to consume tracked data topic.

How do I specify a consumer offset for a client?

You can configure the initCheckpoint parameter to specify a consumer offset for the client. For more information, see Use the SDK demo to consume tracked data.

How do I reset the consumer offset if the number of change tracking tasks exceeds the limit?

1. Open the corresponding code file, such as the DTSConsumerAssignDemo.java or DTSConsumerSubscribeDemo.java file, based on the mode in which you use the SDK client.

   Note

   For more information, see Use the SDK demo to consume tracked data.

2. In the Data Range column on the Change Tracking page, check the data range within which you can reset the consumer offset in the change tracking instance.

3. Select a new consumer offset based on your business requirements and convert the consumer offset to a UNIX timestamp.

4. Specify the initCheckpoint parameter in the code file to replace the original consumer offset with the new UNIX timestamp.

5. Restart the SDK client.

What do I do if I cannot access a change tracking task over VPC by using a client?

This may happen if the server on which the client is hosted is not in the VPC that you specified when you configured the change tracking task. For example, the VPC of the client is changed. In this case, you must reconfigure the change tracking task.

Why is the value of the consumer offset in the console greater than the maximum value in the data range?

The data range of the change tracking task is updated every minute, whereas the consumer offset is updated every 10 seconds. Therefore, if you consume data in real time, the value of the consumer offset may be greater than the maximum value in the data range of the change tracking task.

How does DTS ensure that the data that is tracked by using SDK is a complete transaction?

Based on the provided consumer offset, DTS searches for the complete transaction that corresponds to the consumer offset and distributes data to downstream from the BEGIN statement of the entire transaction. Therefore, a complete transaction can be received.

How do I check whether the tracked data is properly consumed?

If the data is properly consumed, the consumer offset that is displayed in the DTS console moves forward.

What does usePublicIp=true indicate in the change tracking SDK code?

If you set the usePublicIp parameter to true, the SDK accesses the DTS change tracking task over the Internet.

Are my services affected if the primary and secondary databases of the source RDS instance that is configured for the change tracking task are switched over or the primary database is restarted?

No, your services are not affected. DTS adapts to the changes if the primary and secondary databases are switched over or the primary database is restarted in an ApsaraDB RDS for MySQL instance, an ApsaraDB RDS for PostgreSQL instance, a PolarDB for MySQL instance, a PolarDB for PostgreSQL instance, or a PolarDB-X 1.0 instance whose storage type is ApsaraDB RDS for MySQL.

Can RDS automatically download binary logs to a local server?

DTS allows you to track RDS binary logs in real time. You can enable the change tracking feature of DTS to track RDS binary logs and synchronize the logs to your local server in real time by using DTS SDK.

Does the real-time incremental data of change tracking include only new data or both new data and modified data?

The incremental data that can be tracked by DTS includes all added, deleted, and modified data and the changes of schemas caused by DDL operations.

Why do I receive some messages multiple times after the SDK client is restarted if a message is not acknowledged at a consumer client?

If the SDK contains a message that is not acknowledged, the server pushes all messages in the buffer. After the messages are pushed, the SDK can no longer receive messages. In this case, the consumer offset that is stored on the server is the checkpoint of the last message before the message that is not acknowledged. When the SDK client restarts, the server pushes data from the checkpoint of the last message before the message that is not acknowledged to ensure that no messages are lost. Therefore, the SDK client receives some messages multiple times at this time.

How often is the consumer offset of change tracking updated? Why do I sometimes receive a message multiple times when I restart the SDK client?

After the change tracking SDK consumes each message, the SDK must call the ackAsConsumed method to send an acknowledgment to the server. After the server receives the acknowledgment, the server updates the consumer offset in the memory and persists the consumer offset every 10 seconds. If you restart the SDK client before the latest acknowledgment is persisted, the server pushes messages from the consumer offset of the message whose acknowledgment is most recently persisted to make sure that no messages are lost. In this case, the SDK receives a message multiple times.

Am I able to track data in multiple RDS instances by using a change tracking instance?

No, you cannot track data in multiple RDS instances by using a change tracking instance. A change tracking instance can only track data in a single RDS instance.

Does data inconsistency occur in a change tracking instance?

No, change tracking tasks only obtain the changes of the source database and do not involve data inconsistency. If the data that is consumed by the consumer client does not meet expectations, troubleshoot the issue.

What do I do if the "UserRecordGenerator: haven't receive records from generator for 5s" error message appears when I consume tracked data?

If the UserRecordGenerator: haven't receive records from generator for 5s error message appears when you consume tracked data, make sure that the consumer offset is within the offset range of the incremental data collection module and that the consumer client runs as expected.

Am I able to create multiple partitions for a topic?

No, you cannot create multiple partitions for a topic. To ensure the global order of messages, DTS allows you to create only one partition for each topic. The topic is allocated to partition 0.

Others

What is the impact of modifying the data of the destination database when a data synchronization or migration task is in progress?

• The data synchronization or migration task may fail. If you perform operations on the objects in the destination database during data synchronization or migration, exceptions may occur. For example, a primary key conflict may occur, or data records are not updated. In this case, the data synchronization or migration task may fail. If you perform operations that do not interrupt data synchronization or migration, the task is not affected. For example, if you create a table in the destination database and write data to the table, the task is not affected because the table is not an object to be migrated or synchronized.

• DTS reads the information about the source database and migrates or synchronizes full data, schema data, and incremental data to the destination database. Therefore, modifications of data in the destination database may be overwritten by migrated or synchronized data.

What happens if I change the password of the source or destination database when a DTS instance is in use?

DTS returns an error and stops the instance. You can log on to the DTS console and click the instance ID to go to the instance details page. On the Basic Information page, you can change the account and password of the source or destination database. Then, go to the Task Management page. On the Task Management page, find the module for which an error is reported and restart the module.

Why am I unable to connect to some source or destination databases over a public IP address?

The connection type varies based on the task type and the type of the source or destination database. For example, if you select a MySQL database as the source database, you can connect to the source database over a public IP address for a data migration or change tracking task, but not for a data synchronization task.

Does DTS support cross-account data migration or synchronization?

Yes, DTS supports cross-account data migration or synchronization. For more information, see Configure a DTS task across Alibaba Cloud accounts.

The following error is reported for a DTS task whose destination database resides in an ApsaraDB for Redis instance: OOM command not allowed when used memory > 'maxmemory'. Why does this happen?

This error may be caused due to insufficient storage space of the destination ApsaraDB for Redis instance. If the destination ApsaraDB for Redis instance uses the cluster architecture, this error may be caused because the memory usage of a shard reaches the upper limit. In this case, upgrade the specifications of the ApsaraDB for Redis instance.

What is the AliyunDTSRolePolicy policy?

The AliyunDTSRolePolicy policy is used to access cloud resources such as ApsaraDB RDS instances and ECS instances within your Alibaba Cloud account or across Alibaba Cloud accounts when you configure DTS tasks. For more information, see Authorize DTS to access Alibaba Cloud resources.

How do I grant permissions to a RAM role?

Am I able to change the password of a database account for a DTS task?

Why do MaxCompute table names end with the _base suffix?

1. Initial schema synchronization.

   DTS synchronizes the schemas of the required objects from the source database to MaxCompute. During initial schema synchronization, DTS adds the _base suffix to the end of the source table name. For example, if the name of the source table is customer, the name of the table in MaxCompute is customer_base.

2. Initial full data synchronization.

   DTS synchronizes the historical data of the table from the source database to the destination table in MaxCompute. For example, the customer table in the source database is synchronized to the customer_base table in MaxCompute. The data is the basis for subsequent incremental synchronization.

   Note

   The destination table that is suffixed with _base is known as a full baseline table.

3. Incremental data synchronization.

   DTS creates an incremental data table in MaxCompute. The name of the incremental data table is suffixed with _log, such as customer_log. Then, DTS synchronizes the incremental data that was generated in the source database to the incremental data table.

   Note

   For more information, see Schema of an incremental data table.

What do I do if I cannot obtain the information about Kafka topics?

./bin/kafka-topics.sh --describe --zookeeper zk01:2181/kafka --topic topic_name

Am I able to create a local MySQL instance as the secondary database of an RDS instance?

Yes, you can use the data migration feature of DTS to migrate data from the RDS instance to the local MySQL instance in real time. Then, you can use the MySQL instance as the secondary database of the RDS instance.

How do I replicate data from an RDS instance to a newly created RDS instance?

You can use the data migration feature of DTS. When you configure a data migration task, select schema migration, full data migration, and incremental data migration as the migration types. For more information, see Migrate data between ApsaraDB RDS instances.

Am I able to replicate a database that is the same as another database except for the database name in an RDS instance?

Yes, DTS allows you to use the object name mapping feature to replicate a database that is the same as another database except for the database name in an RDS instance.

What do I do if latency always occurs in a DTS instance?

What do I do if the fields are in lowercase after I synchronize or migrate data to the destination database in the DTS console of the previous version?

Configure tasks in the DTS console of the new version and specify the capitalization of object names in the destination database. For more information, see Specify the capitalization of object names in the destination instance.

Am I able to resume a DTS task after the task is paused?

In most cases, a DTS task that is paused for no more than 24 hours can be properly resumed. If the amount of data is small, a DTS task that is paused for no more than seven days can be resumed. We recommend that you do not pause a task for more than 6 hours.

Why does the progress of a task start from 0 after the task is paused and then restarted?

After the task is restarted, DTS queries the data that is transmitted again and continues to process the remaining data. During this process, the task progress may differ from the actual situation due to latency.

What is the principle of lock-free DDL?

For more information about the principle of lock-free DDL operations, see the "Lock-free schema change process" section of the Overview topic.

Am I able to pause the data synchronization or migration of a table?

No, you cannot pause the data synchronization or migration of a table.

Does DTS support Redis 7.0?

Instances of ApsaraDB for Redis V7.0 are supported only as destination instances.

If a task fails, do I need to purchase the task again?

No, you can reconfigure the task.

What happens if multiple tasks write data to the same destination database?

This may cause data inconsistency.

Why is a DTS instance still locked after the instance is renewed?

After you renew a locked DTS instance, it takes a while for the instance to be unlocked.

Am I able to modify the resource group of a DTS instance?

Yes, you can modify the resource group of a DTS instance. You can go to the Basic Information page of the instance. In the Basic Information section, click Edit next to the resource group name.

Does DTS provide a binary log analysis tool?

No, DTS does not provide a binary log analysis tool.

Is it normal that the progress of an incremental data synchronization or migration task is always displayed as 95%?

Yes, it is normal. Incremental data synchronization or migration tasks never stop or complete. The progress cannot reach 100%.

Why is a DTS task not released after it is frozen for more than seven days?

In some cases, frozen tasks are saved for more than seven days.

Am I able to modify the port number of an existing task?

No, you cannot modify the port number of an existing task.

Am I able to downgrade an ApsaraDB RDS for MySQL instance that is mounted to a PolarDB-X 1.0 instance in a DTS task?

We recommend that you do not downgrade the ApsaraDB RDS for MySQL instance. The downgrade operation triggers a primary-secondary switchover, which may cause data loss.

Am I able to upgrade or downgrade the source or destination instance when a DTS task is in progress?

If you upgrade or downgrade the source or destination instance when a DTS task is in progress, the task may be delayed or the data may be lost. We recommend that you do not modify the specifications of the source or destination instance when a DTS task is in progress.

How do DTS tasks affect the source and destination instances?

During full data initialization, DTS uses the read and write resources of the source and destination databases. This may increase the load on the databases. We recommend that you run full data migration or synchronization tasks during off-peak hours.

What is the approximate latency of a DTS task?

The latency of DTS tasks cannot be estimated because the latency is affected by various factors, such as the running load of the source instance, the bandwidth of the transmission network, the network latency, and the write performance of the destination instance.

How do I return to the DTS console of the previous version if I am navigated to the DMS console?

You can move the pointer over the image in the lower-right corner of the DMS console and click the icon to go to the DTS console of the previous version.

Does DTS support encryption?

No, DTS does not support encryption.

Am I able to configure an ApsaraDB for ClickHouse instance as the source or destination instance?

No, you cannot configure an ApsaraDB for ClickHouse instance as the source or destination instance.

Am I able to configure an AnalyticDB for MySQL V2.0 cluster as the source or destination instance?

You can configure an AnalyticDB for MySQL V2.0 cluster only as a destination instance. You can perform the operation only in the DTS console of the previous version, but not in the DTS console of the new version.AnalyticDB for MySQL

Why am I unable to view a newly created task in the DTS console?

Why does data inconsistency occur for a data verification task?

Am I able to modify the gray configuration items of a created task?

No, you cannot modify the gray configuration items of a created task.

How can I configure latency alerts and thresholds?

DTS provides the monitoring and alerting feature for DTS tasks. You can configure alert rules for important metrics in the DTS console to monitor DTS tasks in real time. For more information, see Configure monitoring and alerting.

Am I able to view the cause of a task failure that happened an extended period of time ago?

No, you cannot view the cause of a task failure that happened an extended period of time ago? If a task failed an extended period of time ago, such as more than seven days ago, related logs are cleared. In this case, you cannot view the cause of the failure.

Am I able to resume a task that failed an extended period of time ago?

No, you cannot resume a task that failed an extended period of time ago. If a task failed an extended period of time ago, such as more than seven days ago, related logs are cleared. In this case, you must reconfigure the task.

What is the rdsdt_dtsacct account?

If you do not create the rdsdt_dtsacct account, the account may be created by DTS. DTS creates the built-in database account named rdsdt_dtsacct in some database instances to connect to the source and destination database instances.

How do I view the information about heap tables, tables without primary keys, compressed tables, and tables that contain computed columns in an SQL Server database?

What do I do if the schemas of the source and destination databases are inconsistent?

You can use the object name mapping feature to map the columns of the source database to those of the destination database. For more information, see Map object names.

Am I able to modify the type of a column by using the object name mapping feature?

No, you cannot modify the type of a column by using the object name mapping feature.

Am I able to limit the speed at which the source database is read?

No, you cannot limit the speed at which the source database is read. Before you start a task, you must evaluate the performance of the source database, such as whether the IOPS and network bandwidth meet the requirements of the source database. We recommend that you run the task during off-peak hours.

How do I delete orphaned documents of a MongoDB database deployed in the sharded cluster architecture?

Deletion of DATABASE.COLLECTION range [{ KEY: VALUE1 }, { KEY: VALUE2 }) will be scheduled after all possibly dependent queries finish

db.getSiblingDB("admin").aggregate( [{ $currentOp : { allUsers: true, idleCursors: true } },{ $match : { type: "idleCursor" } }] )

What do I do if the data of a MongoDB database deployed in the sharded cluster architecture is not evenly distributed?

You can enable the balancer and perform pre-sharding to effectively resolve the issue that most data is written to a single shard.

Enable the balancer

If the balancer is disabled or the specified active time window of the balancer is not reached, you can enable the balancer or temporarily cancel the time window of the balancer. This way, you can immediately balance the data distribution.

1. Connect to the MongoDB database deployed in the sharded cluster architecture.

2. After you connect to a mongos node, run the following command in the mongo shell to switch to the config database:

   use config

3. Perform the following operations based on your business requirements.

   • Run the following command to enable the balancer:

     sh.setBalancerState(true)

   • Run the following command to temporarily cancel the time window of the balancer:

     db.settings.updateOne( { _id : "balancer" }, { $unset : { activeWindow : true } } )

Perform pre-sharding

MongoDB allows you to configure ranged sharding or hash sharding. You can perform pre-sharding to distribute the values of chunks to as many shard nodes as possible. This way, the data can be evenly distributed during data synchronization or migration.

sh.shardCollection("phonebook.contacts", { last_name: "hashed" }, false, {numInitialChunks: 16384})

sh.splitAt("<db>.<coll>", {"<shardKey>":<split_value>})

sh.splitAt("test.test", {"id":0})
sh.splitAt("test.test", {"id":50000})
sh.splitAt("test.test", {"id":75000})