DataWorks Data Integration reads messages from Kafka topics and writes them to AnalyticDB for MySQL tables. A batch synchronization task connects a Kafka Reader to an AnalyticDB for MySQL 3.0 Writer and runs on an exclusive resource group for Data Integration.
Prerequisites
-
An exclusive resource group for Data Integration that meets your business requirements is purchased. For more information, see Create and use an exclusive resource group for Data Integration.
-
Network connections between the exclusive resource group for Data Integration and your data sources (both Kafka and AnalyticDB for MySQL) are established. For more information, see Establish a network connection between a resource group and a data source.
Create a batch synchronization task
To import data from Kafka to AnalyticDB for MySQL, configure the source reader, configure the destination writer, and then create a synchronization task that connects them.
-
Step 1: Configure the Kafka Reader
Configure the source reader to read data from your Kafka cluster.
For configuration details, see Kafka Reader.
-
Step 2: Configure the AnalyticDB for MySQL 3.0 Writer
Configure the destination writer to write data to your AnalyticDB for MySQL table.
For configuration details, see AnalyticDB for MySQL 3.0 Writer.
-
Step 3: Create the synchronization task
Combine the Kafka Reader and AnalyticDB for MySQL 3.0 Writer into a data synchronization job. The codeless UI in DataWorks lets you configure the source, destination, and field mappings without writing code.
For step-by-step instructions, see Configure a batch synchronization task by using the codeless UI.