If your cluster node specifications exceed your business needs due to traffic fluctuations or other changes, you can use the Alibaba Cloud Elasticsearch (ES) cluster downgrade feature to reduce node specifications or change node disk types. This feature helps you manage costs while supporting business growth.
Prerequisites
Make sure that the cluster is in the Normal (green) state.
In the Kibana console of your cluster, check whether your cluster stores indexes in the close state. If your cluster stores such indexes, you must open the indexes. Otherwise, the upgrade fails.
Run the following command to view the statuses of indexes:
GET /_cat/indices?v
Run the following command to open an index in the close state:
POST /<index_name>/_openReplace <index_name> with the name of the index in the close state.
Log on to the Kibana console and run the following command to check the number of replicas for your indexes. The number of replicas must be at least 1.
NoteFor multi-zone instances, make sure that the number of replicas for each index is less than the number of zones before you downgrade the instance. We recommend setting the number of replicas to 1. After the downgrade is complete, you can increase the number of replicas as needed. For more information, see Index templates.
If the cluster is heavily loaded, has no replicas, and experiences a high volume of write or query operations during the downgrade, cluster access might time out. This compromises the high-availability mechanism and business stability.
GET _cat/indices?v
Limits
You can downgrade a cluster only if the following conditions are met:
Downgrade interval
The interval between two downgrades on the same cluster must be at least 30 minutes.
Cluster load
To ensure cluster stability during a downgrade, the load on different node roles must meet the following conditions.
Node type
CPU utilization
JVM heap memory usage
Dedicated master node
Maximum CPU utilization of a single node in the last 24 hours: < 30%
Maximum JVM heap memory usage of a single node in the last 24 hours: < 25%
Other node roles
Both of the following conditions must be met:
Maximum CPU utilization of a single node in the last 24 hours: < 50%
Average CPU utilization of all nodes in the last 24 hours: < 30%
Both of the following conditions must be met:
Maximum JVM heap memory usage of a single node in the last 24 hours: < 50%
Average JVM heap memory usage of all nodes in the last 24 hours: < 30%
Specifications
The target CPU and memory specifications must be greater than or equal to half of the current specifications. You cannot downgrade a node to the following specifications: 1 CPU core and 2 GiB of memory, 2 CPU cores and 2 GiB of memory, 2 CPU cores and 4 GiB of memory, or 4 CPU cores and 4 GiB of memory.
NoteYou cannot downgrade Kibana nodes to 1 CPU core and 2 GiB of memory.
To downgrade to 2 CPU cores and 4 GiB of memory or 4 CPU cores and 4 GiB of memory, you must create a new instance with the target specifications. Then, migrate the data from the original instance to the new one. For example, you can use Logstash to migrate the data.
Disk type downgrade
You can downgrade disks from a higher performance level to a lower one. The disk types are listed in descending order of performance: enterprise SSDs (ESSDs), standard SSDs, and ultra disks. You can downgrade the disk type as needed. For more information about disks, see Disk overview.
NoteYou cannot downgrade ESSD PL0 disks to standard SSDs.
For ES V7.16, V8.5, V8.9, and later, you can reduce the storage space of data nodes. To ensure cluster stability, the disk usage must remain below a safe level during the process. The disk usage after the downgrade must not exceed 60%. This is calculated as follows:
(Current disk space used) / (Disk space after downgrade) < 60%.
Precautions
If your cluster indexes have replica shards and the cluster load is normal, the cluster can typically continue to provide service during the downgrade. A normal load is defined as CPU utilization of approximately 60%, heap memory usage of approximately 50%, and a load_1m value lower than the number of CPU cores.
Downgrading a cluster triggers a restart. The restart duration depends on factors such as cluster specifications, data structure, and data size. We recommend that you perform the downgrade during off-peak hours. The restart process can be lengthy and may take several hours. For more information, see Restart an instance or node.
A downgrade does not cause data loss. However, if the cluster load is high or the cluster status is abnormal, you might experience occasional access timeouts or jitter. We recommend implementing a retry mechanism in your application and increasing the number of replicas.
For clusters with non-standard specifications, such as a cluster with only two data nodes, a downgrade can pose additional risks such as data loss. Proceed with caution.
Kibana is typically used as a visualization platform for operations such as real-time data queries. Therefore, historical usage checks are not performed when you downgrade Kibana nodes. You can configure and adjust the specifications based on your needs. If usage increases later, you must promptly upgrade to higher specifications.
After you submit a downgrade order, the instance is billed based on the new configuration. For billing rules, see Pay-as-you-go and Subscription.
NoteWhen you downgrade a cluster, you can view the billing details for the new configuration in real time on the Downgrade page.
Procedure
Log on to the Alibaba Cloud Elasticsearch console.
In the top menu bar, select a resource group and a region. In the navigation pane on the left, click Elasticsearch Instances.
In the instance list, find the target instance. In the Actions column, click the .
Change the node specifications or storage class as needed.
Read and agree to the Terms of Service and risk notifications, and then click Buy Now.
After you complete the payment, the cluster restarts. The downgrade is complete after the cluster successfully restarts.
FAQ
References
For information about the API operation used to downgrade a cluster, see UpdateInstance.
See Specification and capacity evaluation and Limits to ensure that your cluster has sufficient storage space after the downgrade. If the cluster load is high after the downgrade, you must promptly upgrade the cluster. For more information, see Upgrade a cluster.
> Downgrade Configuration