When you upgrade the traffic specifications of a Message Queue for Apache Kafka instance, the corresponding cluster may be scaled out. After the cluster is scaled out, you must rebalance the topic traffic to evenly distribute the traffic across brokers in the scaled-out cluster. Otherwise, the original topic traffic is still distributed across the brokers that are in the cluster before the scale-out. The original topics are subject to the maximum bandwidth purchased before the scale-out. New topics are not subject to this maximum bandwidth.
When your Message Queue for Apache Kafka instance is in the Running (Pending Rebalancing) state, you can use this instance to send and consume messages but cannot create resources such as topics and consumer groups in this instance. You must wait until the topic traffic is rebalanced or choose not to rebalance the topic traffic before you can create a resource.
Traffic rebalancing methods
|Traffic rebalancing method||Principle||Impact||Scenario||Duration|
|Add Partitions to All Topics||After the cluster is scaled out, the system adds partitions to the new brokers for all topics on the original brokers.||
|Migrate Data from Partitions of All Topics (Recommended)||
||All cluster scale-out scenarios are supported.||
|Do Not Rebalance (Not Recommended)||You do not need to perform operations. The original topics are still distributed on the brokers of the cluster before the scale-out, and new topics are evenly distributed across all brokers after the scale-out.||
||None. The rebalancing immediately takes effect.|
- Log on to the Message Queue for Apache Kafka console.
- In the Resource Distribution section of the Overview page, select the region where your instance resides.
- On the Instances page, click the name of the instance that you want to manage.
- In the Overview section of the Instance Details page, click Rebalance Topic Traffic in the upper-right corner.
- In the Rebalance Topic Traffic for Instance panel, set the Traffic Rebalancing Method parameter. For more information about the supported traffic rebalancing methods, see Traffic rebalancing methods.
After you select a traffic rebalancing method, all topics in the instance enter the Pending Rebalancing state. You can check the topic status in the Status column on the Topics page.