You can manage Kafka metadata in E-MapReduce (EMR) V3.17.0 and later versions. Kafka metadata is automatically created for new Kafka clusters. This topic describes basic operations on Kafka metadata.

Go to the Kafka Data Management page

  1. Log on to the EMR console.
  2. In the top navigation bar, select the region where your cluster resides and select a resource group based on your business requirements.
  3. Click the Metadata tab.
  4. In the left-side navigation pane, click Kafka Data Management.

Add a topic

  1. Go to the Kafka Data Management page.
  2. On the Kafka Data Management page, click Add Topic in the upper-right corner.
  3. In the Add Topic dialog box, configure parameters in the Basic Configuration section.
  4. Optional:In the Advanced Settings section, click in the upper-right addcorner to add key-value pair settings.
  5. Click OK.
    You can click Tasks to view the results.
    • If Status is Successful, the topic is added.
    • If Status is Failed, you can click View Details in the Action column to identify the cause.

Remove a topic

Notice
  • You cannot remove built-in topics __consumer_offsets and _schemas.
  • You cannot remove a topic if the cluster that is associated with the topic is released.
  1. Go to the Kafka Data Management page.
  2. Find the topic you want to remove and click Delete in the Actions column.
  3. Click OK.
    You can click Tasks to view the results.
    • If Status is Successful, the topic is added.
    • If Status is Failed, you can click View Details in the Action column to identify the cause.

Update topic configurations

Notice
  • You cannot update the configurations of built-in topics __consumer_offsets and _schemas.
  • You cannot update the configurations of a topic if the cluster that is associated with the topic is released.
  1. Go to the Kafka Data Management page.
  2. Find the topic that contains the configurations you want to update and click Update in the Actions column.
  3. Modify configurations.
  4. Click OK.
    You can click Tasks to view the results.
    • If Status is Successful, the topic is added.
    • If Status is Failed, you can click View Details in the Action column to identify the cause.

View topic details

  1. Go to the Kafka Data Management page.
  2. Find your topic and click Details in the Actions column.
    You can view the following information about a topic: monitoring data, summary information, data distribution, and consumer groups.

Edit multiple partitions at the same time

  1. Go to the Kafka Data Management page.
  2. Click Batch Edit Partitions in the upper-right corner.
  3. In the Batch Edit Partitions dialog box, click Select Topic.
  4. In the Select Topic dialog box, select the cluster to which the partitions you want to edit belong from the Cluster ID drop-down list.
  5. Select the topics that contain the partitions you want to edit and click OK.
  6. In the Batch Edit Partitions dialog box, specify Partitions after Adjustment(≥ Partitions).
  7. Click OK.
    You can click Tasks to view the results.
    • If Status is Successful, the topic is added.
    • If Status is Failed, you can click View Details in the Action column to identify the cause.