DataWorks Data Integration reads messages from Kafka topics and writes them to AnalyticDB for MySQL tables through a batch synchronization task that runs on an exclusive resource group for Data Integration.
Prerequisites
-
An exclusive resource group for Data Integration that meets your business requirements is purchased. For more information, see Create and use an exclusive resource group for Data Integration.
-
Network connections between the exclusive resource group for Data Integration and your data sources (both Kafka and AnalyticDB for MySQL) are established. For more information, see Establish a network connection between a resource group and a data source.
Create a batch synchronization task
Configure the Kafka source reader, the AnalyticDB for MySQL destination writer, and then create a synchronization task that connects them.
-
Step 1: Configure the Kafka Reader
Configure the source reader to read data from your Kafka cluster.
For configuration details, see Kafka Reader.
-
Step 2: Configure the AnalyticDB for MySQL 3.0 Writer
Configure the destination writer to write data to your AnalyticDB for MySQL table.
For configuration details, see AnalyticDB for MySQL 3.0 Writer.
-
Step 3: Create the synchronization task
Combine the Kafka Reader and AnalyticDB for MySQL 3.0 Writer into a synchronization job. The codeless UI in DataWorks lets you configure the source, destination, and field mappings without writing code.
For step-by-step instructions, see Configure a batch synchronization task by using the codeless UI.