A Message Queue for Apache Kafka instance can be connected to Filebeat as an input. This topic shows you how to consume messages in Message Queue for Apache Kafka over the Internet by using Filebeat.
Background information
- A Message Queue for Apache Kafka instance is purchased and deployed. For more information, see Access from the Internet and VPC.
- Filebeat is downloaded and installed. For more information, see Download Filebeat.
- Java Development Kit (JDK) 8 is downloaded and installed. For more information, see Download JDK 8.
Step 1: Obtain an endpoint
Filebeat establishes a connection to Message Queue for Apache Kafka by using a Message Queue for Apache Kafka endpoint.
Step 2: Create a topic
Perform the following operations to create a topic for storing messages:
Step 3: Send messages
Perform the following operations to send messages to the topic that you created:
Step 4: Create a consumer group
Perform the following operations to create a consumer group for Filebeat:
Step 5: Use Filebeat to consume messages
Start Filebeat on the server where Filebeat is installed to consume messages from the created topic.