This topic describes how to import data from Message Queue for Apache Kafka to MaxCompute.

Background information

Message Queue for Apache Kafka is a distributed, high-throughput, and scalable message queue service that is developed by Alibaba Cloud based on open source Apache Kafka. Message Queue for Apache Kafka is widely used in big data scenarios, such as log collection, monitoring data aggregation, streaming data processing, and online and offline analysis. It has become an indispensable part of the big data ecosystem. Message Queue for Apache Kafka provides fully managed services and is more professional, reliable, and secure. You do not need to pay attention to deployment and operations and maintenance (O&M).

MaxCompute is integrated with Message Queue for Apache Kafka. You can use the MaxCompute sink connectors provided by Message Queue for Apache Kafka to continuously import data from specific topics to MaxCompute tables. This process requires no third-party tools or secondary development, which significantly simplifies data import from Message Queue for Apache Kafka to MaxCompute and reduces both development and O&M costs.

Procedure

Create a MaxCompute sink connector. Then, import data from a source topic in a Message Queue for Apache Kafka instance to a MaxCompute table. For more information, see Create a MaxCompute sink connector.