Rebalance partitions across a cluster or redirect traffic for a specific topic from the console to optimize disk utilization.
Background
Partition rebalancing
An uneven distribution of partitions across your topics can skew your cluster, leading to underutilized disk performance and capacity. The standard solution is to increase the topic partition count to a recommended multiple for the cluster. In production environments where you cannot immediately adjust partitions, use the partition rebalancing feature instead. It redistributes the partitions of all cloud storage topics as evenly as possible across all nodes.
Traffic redirection
If a cloud storage topic has high traffic and an uneven partition distribution, disk usage can spike on a specific node. Use the traffic redirection feature to move that topic's traffic to a node with lower disk usage.
Risks
To maintain cluster stability, partition rebalancing works on only one topic at a time. Traffic redirection for cloud storage topics completes in seconds but triggers clients to update metadata and reconnect. Ensure your clients can update metadata and reconnect automatically before you start. Data migration for local storage topics is slower—use caution when performing this operation on such topics.
Procedure
Log on to the ApsaraMQ for Kafka console. In the left-side navigation pane, click Instances.
In the top navigation bar, select the region where the instance that you want to manage resides.
-
Configure partition rebalancing or traffic redirection.
-
Rebalance partitions for a cluster.
-
On the Instances page, find the target instance and choose in the Actions column.
-
Carefully read the information in the dialog box and click OK.
-
-
Redirect traffic for a topic.
-
On the Instances page, click the name of the target instance.
-
In the navigation pane on the left, click Topics. On the page that appears, find the target topic and choose in the Actions column.
-
Carefully read the information in the dialog box and click OK.
-
-