This topic describes how to create a DLA sink connector to synchronize data from Message Queue for Apache Kafka to Data Lake Analytics (DLA) for analytics and computing.
Prerequisites
- DLA
- DLA is activated. For more information, see Activate DLA.
- A virtual cluster that uses the Spark engine is created. For more information, see Create a virtual cluster.
- The AliyunDLAFullAccess policy is attached to the RAM user that is created to use the connector feature. For more information, see Manage RAM users.
- The RAM user that is created to use the connector feature is bound to a DLA sub-account. For more information, see Bind a DLA sub-account to a RAM user.
- Message Queue for Apache Kafka
- A Message Queue for Apache Kafka instance is created. For more information, see Access from a VPC.
- A topic is created in the Message Queue for Apache Kafka instance. For more information, see the "Step 2: Create a topic" section of the Connect a Message Queue for Apache Kafka instance to Filebeat as an input topic.
- Messages are sent to the created topic. For more information, see Send messages.