Symptoms

A topic is created on the Topics page of the Message Queue for Apache Kafka console. When I use Filebeat to send a message to the topic, the Request was for a topic or partition that does not exist on this broker error message is returned.

Causes

When Filebeat sends a message to a topic in Message Queue for Apache Kafka, Filebeat automatically converts the uppercase letters in the topic name into lowercase letters. For example, if you use Filebeat to send a message to a topic named AAA, Filebeat automatically converts the name of the topic into aaa. However, no topic named aaa exists in Message Queue for Apache Kafka. Therefore, the Request was for a topic or partition that does not exist on this broker error message is returned.

Solutions

Create a topic whose name contains only lowercase letters on the Topics page of the Message Queue for Apache Kafka console.