ApsaraDB for MongoDB:Migrate a self-managed MongoDB replica set with DTS

Parameter

Description

Task Name

The task name. DTS generates a name automatically. Specify a descriptive name to identify the task easily. Task names do not need to be unique.

Select Existing Connection

If the source database is registered with DTS, select it from the drop-down list. DTS populates the remaining parameters automatically. Otherwise, configure the parameters below manually.

Database Type

Select MongoDB.

Access Method

Select the connection type based on the location of the source database. This topic uses Public IP Address as an example. If you select a different connection type, complete the required preparations.

Instance Region

Select the region where the source database resides. If the region is not listed, select the geographically closest region.

Architecture

Select Replica Set.

Migration Method

Select the method for migrating incremental data: Oplog (recommended) or ChangeStream. Oplog is available when the oplog feature is enabled on the source. ChangeStream is available when change streams are enabled. If the source is an inelastic Amazon DocumentDB cluster, you must select ChangeStream and set the Architecture parameter to Sharded Cluster. If you select Sharded Cluster for the Architecture parameter, you do not need to configure the Shard account and Shard password parameters.

Endpoint Type

Select Standalone or Multi-node. Available when Access Method is Express Connect, VPN Gateway, or Smart Access Gateway, Public IP Address, or Cloud Enterprise Network (CEN).

Domain Name or IP

The domain name or IP address of the source database. Available when Endpoint Type is Standalone.

Port Number

The service port of the source database. Available when Endpoint Type is Standalone.

Endpoint

The endpoint of the source database in <IP>:<Port> format. Press Enter to add multiple endpoints. Available when Endpoint Type is Multi-node.

Authentication Database

The database that the source account belongs to. Default: admin.

Database Account

The account used to connect to the source database. For required permissions, see Permissions required. If Access Method is Self-managed Database on ECS or Database Gateway, enter the account of the shard node.

Database Password

The password for the database account.

Encryption

The connection encryption method: Non-encrypted, SSL-encrypted, or Mongo Atlas SSL. Available options depend on Access Method and Architecture. SSL-encrypted is unavailable when Architecture is Sharded Cluster and Migration Method is Oplog. If Architecture is Replica Set, Access Method is not Alibaba Cloud Instance, and Encryption is SSL-encrypted, upload a CA certificate to verify the connection.

Parameter

Description

Select Existing Connection

If the destination instance is registered with DTS, select it from the drop-down list. Otherwise, configure the parameters below manually.

Database Type

Select MongoDB.

Access Method

Select Alibaba Cloud Instance.

Instance Region

Select the region where the destination ApsaraDB for MongoDB instance resides.

Replicate Data Across Alibaba Cloud Accounts

Select No to use an instance in the current account.

Architecture

Select the architecture of the destination instance.

Instance ID

Select the ID of the destination instance.

Authentication Database

The database that the destination account belongs to. Default: admin.

Database Name

The name of the database in the destination instance where migrated objects will be stored.

Database Account

The account used to connect to the destination instance. For required permissions, see Permissions required.

Database Password

The password for the database account.

Encryption

The connection encryption method. SSL-encrypted is unavailable when the destination uses a sharded cluster architecture.

Parameter

Description

Migration Types

Select the migration types: Schema Migration, Full Data Migration, and optionally Incremental Data Migration. For zero-downtime migration, select all three. If you skip Schema Migration, create the target databases and collections in the destination before starting. If you skip Incremental Data Migration, do not write to the source during migration.

Processing Mode of Conflicting Tables

Precheck and Report Errors: fails the precheck if the destination contains collections with the same names as the source. Use object name mapping to rename migrated collections if existing collections cannot be deleted. Ignore Errors and Proceed: skips the precheck. DTS does not migrate records with the same primary keys as existing destination records. Data consistency is not guaranteed.

Capitalization of object names in destination instance

The capitalization policy for database and collection names in the destination. Default: DTS default policy. See Specify the capitalization of object names in the destination instance.

Source Objects

Select databases or collections to migrate. Click the icon to add them to Selected Objects.

Selected Objects

Right-click an object to rename it in the destination (object name mapping), set the incremental migration mode, or specify WHERE conditions for full migration data filtering. To remove an object, click it and then click the icon.

Parameter

Description

Dedicated Cluster for Task Scheduling

By default, DTS schedules tasks on a shared cluster. Purchase a dedicated cluster for isolated resources. See What is a DTS dedicated cluster?

Retry Time for Failed Connections

The retry duration for connection failures. Valid values: 10–1,440 minutes. Default: 720 minutes. Set this to at least 30 minutes. If different tasks share the same source or destination database, the value set last takes precedence.

Retry Time for Other Issues

The retry duration for DDL or DML operation failures. Valid values: 1–1,440 minutes. Default: 10 minutes. Set this to at least 10 minutes. This value must be less than Retry Time for Failed Connections.

Enable Throttling for Full Data Migration

Limits read/write load on source and destination during full migration. Configure QPS to the source database, RPS of Full Data Migration, and data migration speed. Available only when Full Data Migration is selected.

Only one data type for primary key `_id` in a table of the data to be synchronized

Yes: DTS migrates only one data type of _id per collection without scanning all types. No: DTS scans and migrates all data types of _id. Enable this based on your data. Incorrect configuration may cause data loss. Available only when Full Data Migration is selected.

Enable Throttling for Incremental Data Migration

Limits load during incremental migration. Configure RPS of Incremental Data Migration and data migration speed. Available only when Incremental Data Migration is selected.

Environment Tag

An optional tag to identify the instance.

Configure ETL

Enable the extract, transform, and load (ETL) feature to transform data during migration. See Configure ETL in a data migration or data synchronization task.

Monitoring and Alerting

Configure alerts for task failure or high migration latency. If enabled, set the alert threshold and notification contacts. See Configure monitoring and alerting.

Parameter

Description

Resource Group

The resource group for the migration instance. Default: default resource group. See What is Resource Management?

Instance Class

The instance class determines migration speed. Select based on your data volume and timing requirements. See Instance classes of data migration instances.