This topic describes how to migrate incremental data from a PolarDB-X V2.0 instance to a Message Queue for Apache Kafka instance in real time by using Data Transmission Service (DTS). Message Queue for Apache Kafka has an extended capability to process messages.
Prerequisites
- The source PolarDB-X V2.0 instance is created and compatible with MySQL 5.7.
- In the destination Message Queue for Apache Kafka instance, a topic is created to receive the migrated data. For more information, see Step 1: Create a topic.
- The version of the source PolarDB-X instance and the destination Message Queue for Apache Kafka instance are supported. For more information, see Overview of data migration scenarios.
- The available storage space of the destination Message Queue for Apache Kafka instance is larger than the total size of the data in the source PolarDB-X V2.0 instance.
Precautions
Billing
Migration type | Task configuration fee | Internet traffic fee |
---|---|---|
Schema migration and full data migration | Free of charge. | Charged only when data is migrated from Alibaba Cloud over the Internet. For more information, see Pricing. |
Incremental data migration | Charged. For more information, see Pricing. |
Migration types
- Schema migration
DTS migrates the schemas of required objects from the source database to the destination database.
- Full data migration
DTS migrates historical data of required objects from the source database to the destination database.
- Incremental data migration
After full data migration is completed, DTS migrates incremental data from the source database to the destination database. Incremental data migration ensures service continuity when you migrate data between self-managed databases.
SQL operations that can be migrated
Operation type | SQL statement |
---|---|
DML | INSERT, UPDATE, and DELETE |
Permissions required for database accounts
Database | Schema migration | Full data migration | Incremental data migration |
---|---|---|---|
PolarDB-X V2.0 instance | The SELECT permission | The SELECT permission | The SELECT permission on the objects to be migrated, the REPLICATION SLAVE permission, and the REPLICATION CLIENT permission. DTS automatically grants these permissions to the database account. |