Symptom
After you create a topic on the Topics page of the ApsaraMQ for Kafka console, Filebeat returns the following error:
Request was for a topic or partition that does not exist on this brokerCause
Filebeat automatically converts uppercase letters in Kafka topic names to lowercase before sending messages.
For example, if your topic is named AAA, Filebeat converts the name to aaa and attempts to send messages to the lowercase topic. Because no topic named aaa exists in your Kafka instance, the broker returns the error.
Solution
Create a topic whose name contains only lowercase letters on the Topics page of the ApsaraMQ for Kafka console.