This topic describes how to migrate data from a PolarDB-X 2.0 instance to a Message Queue for Apache Kafka instance by using Data Transmission Service (DTS). Message Queue for Apache Kafka has an extended capability to process messages.
Prerequisites
- The source PolarDB-X 2.0 instance is created and compatible with MySQL 5.7.
- In the destination Message Queue for Apache Kafka instance, a topic is created to receive the migrated data. For more information, see Step 1: Create a topic.
- The versions of the source PolarDB-X 2.0 instance and the destination Message Queue for Apache Kafka instance are supported. For more information, see Overview of data migration scenarios.
- The available storage space of the destination Message Queue for Apache Kafka instance is larger than the total size of the data in the source PolarDB-X 2.0 instance.
Limits
Category | Description |
---|---|
Limits on the source database |
|
Other limits |
|
Precautions | DTS updates the `dts_health_check`.`ha_health_check` table in the source database as scheduled to move forward the binary log file position. |
Billing
Migration type | Instance configuration fee | Internet traffic fee |
---|---|---|
Schema migration and full data migration | Free of charge. | Charged only when data is migrated from Alibaba Cloud over the Internet. For more information, see Billing overview. |
Incremental data migration | Charged. For more information, see Billing overview. |
Migration types
- Schema migration
DTS migrates the schemas of required objects from the source database to the destination database.
- Full data migration
DTS migrates historical data of required objects from the source database to the destination database.
- Incremental data migration
After full data migration is complete, DTS migrates incremental data from the source database to the destination database. Incremental data migration allows you to ensure service continuity when you migrate data between self-managed databases.
SQL operations that can be synchronized during incremental data migration
Operation type | SQL statement |
---|---|
DML | INSERT, UPDATE, and DELETE |
Permissions required for database accounts
Instance type | Schema migration | Full data migration | Incremental data migration |
---|---|---|---|
PolarDB-X 2.0 instance | The SELECT permission | The SELECT permission | The SELECT permission on the objects to be migrated, and the REPLICATION SLAVE and REPLICATION CLIENT permissions. DTS automatically grants these permissions to the database account. |