Your business is developing, and you may have higher requirements for the configuration of your Elasticsearch cluster. If the current configuration of your Elasticsearch cluster cannot meet your business requirements, you can upgrade the configuration. This topic describes how to upgrade the configuration of an Elasticsearch cluster and the related precautions.

Prerequisites

The following operations are performed:
  • Evaluate the specifications and storage capacity of your cluster.

    For more information, see Evaluate specifications and storage capacity.

  • Log on to the Kibana console and check whether your cluster stores indexes in the close state. If your cluster stores such indexes, you must open or delete the indexes. Otherwise, the upgrade fails.
    • Run the following command to view the statuses of indexes:
      GET /_cat/indices?v
      View the statuses of indexes
    • Run the following command to open an index in the close state:
      POST /<index_name>/_open
    • Run the following command to delete an index in the close state:
      Warning Proceed with caution because the deleted indexes cannot be recovered.
      DELETE /<index_name>

Precautions

  • Impact on services
    • After you upgrade the configuration of your cluster, the system restarts the cluster to make the changes take effect. The time required for the restart depends on the specifications, data structure, and data volume of the cluster. In most cases, the restart requires a few hours. Therefore, we recommend that you upgrade the configuration of your cluster during off-peak hours. For more information, see Restart a cluster or node.
      Notice
      • In most cases, if the indexes of your cluster have replica shards and the load of your cluster is normal, your cluster can still provide services during a cluster configuration upgrade. The following items indicate that the load of a cluster is normal: CPU utilization is about 60%, heap memory usage is about 50%, and the value of NodeLoad_1m is less than the number of vCPUs.
      • If the indexes of your cluster do not have replica shards, the load of the cluster is excessively high, and large amounts of data are written to or queried in your cluster, access to the cluster may time out during a cluster configuration upgrade. We recommend that you configure an access retry mechanism for your client before you upgrade the configuration of your cluster. This reduces the impact on your business.
    • If your cluster is in an abnormal state (indicated by the color yellow or red), you must select Forced Update. This may affect services.
  • Specification upgrades
    You can upgrade the configuration of only one type of node during each upgrade. The node types include data nodes, warm nodes, client nodes, dedicated master nodes, Kibana nodes, and elastic nodes.
    Note You can remove data nodes from your cluster to downgrade the configuration of the cluster. For more information about how to remove data nodes, see Scale in an Elasticsearch cluster.
  • Updates of cloud disk types

    Cloud disks with low storage performance can be updated to cloud disks with high storage performance. The following types of cloud disks are listed in ascending order of their storage performance: ultra disks, standard SSDs, and enhanced SSDs (ESSDs). You can update the cloud disk type of your cluster based on your business requirements. For more information about cloud disks, see Disks.

    Note You cannot update SSDs to ESSDs at performance level 0.
  • Version upgrades
    You cannot upgrade the version of your cluster during a configuration upgrade. For more information about how to upgrade the version of a cluster, see Upgrade the version of a cluster.
    Notice If you perform a version upgrade during a configuration upgrade, the system displays the "UpgradeVersionMustFromConsole" error message.
  • Changes in billing
    After you submit a configuration upgrade order, your cluster is charged based on the new configuration.
    Note During a configuration upgrade, you can check the price of your order on the Upgrade/Downgrade page in real time.
  • To improve the health and stability of Elasticsearch clusters, Alibaba Cloud no longer provides nodes (except Kibana nodes) with the specifications of 1 vCPU and 2 GiB of memory, dedicated master nodes with the specifications of 2 vCPUs and 2 GiB of memory, and Elasticsearch V7.4 clusters since May 2021. If your cluster contains the preceding nodes or your cluster is of V7.4, we recommend that you perform one of the following operations before you upgrade the configuration of your cluster:
    • If your cluster contains the preceding nodes, upgrade the specifications of the nodes to specifications that are provided on the buy page. For more information about the specifications that are provided on the buy page, see Parameters on the buy page.
    • If your cluster is of V7.4, purchase a V7.10 cluster and migrate data from the original cluster to the V7.10 cluster.

Procedure

  1. Log on to the Elasticsearch console.
  2. In the left-side navigation pane, click Elasticsearch Clusters.
  3. Navigate to the desired cluster.
    1. In the top navigation bar, select the resource group to which the cluster belongs and the region where the cluster resides.
    2. In the left-side navigation pane, click Elasticsearch Clusters. On the Elasticsearch Clusters page, find the cluster and click its ID.
  4. In the lower-right corner of the Basic Information page, choose Configuration Update > Upgrade.
  5. On the Upgrade/Downgrade page, change the configuration of the cluster, such as node specifications, the storage type, or storage space per node.

    The Current Config section of the Upgrade/Downgrade page displays the current configuration of the cluster. You can use this as a reference during the upgrade.

    Follow the instructions on the Upgrade/Downgrade page to upgrade the configuration of your cluster based on your business requirements. For more information about the parameters on the page, see Parameters on the buy page. The following table describes only some of the parameters.

    Notice If the zone where your cluster resides does not provide sufficient resources for the configuration upgrade, you can migrate the nodes in the zone to another before the upgrade. For more information, see Migrate nodes in a zone.
    Parameter Description
    Data Node If the value of Disk Type in the Current Config section is Cloud SSD, you can increase the value of Node Storage for data nodes. The maximum storage space supported by a single node depends on the disk type of the node. You can check specific limits in the Elasticsearch console.
    Notice If the value of Disk Type in the Current Config section is Ultra Disk and your cluster is in an abnormal state (indicated by the color yellow or red), you cannot increase the value of Node Storage to a value greater than 2,048. If you want to increase the value of Node Storage to a value greater than 2,048, you must make sure that your cluster is in a normal state before the upgrade, or you can increase the number of data nodes during the upgrade.
    Dedicated Master Node You can purchase or upgrade dedicated master nodes.
    Notice The specifications of 1 vCPU and 2 GiB of memory are designed only for testing purposes. Do not use such specifications for production purposes. The service level agreement (SLA) does not apply to such specifications. Therefore, we recommend that you upgrade your nodes with the specifications of 1 vCPU and 2 GiB of memory.
    Warm Node You can purchase or upgrade warm nodes.
    Client Node You can purchase or upgrade client nodes.
    Kibana Node You can upgrade your Kibana node.
    Notice When you purchase a cluster, Alibaba Cloud provides a Kibana node for you free of charge. This Kibana node offers 1 vCPU and 2 GiB of memory. You can upgrade the Kibana node on the Upgrade/Downgrade page.
    Forced Update If your cluster is in an abnormal state (indicated by the color red or yellow) and your services are severely affected, you must immediately upgrade the cluster configuration. In this case, we recommend that you select Forced Update. The system will perform a forced update regardless of the cluster status. The update requires only a short period of time.
    Notice
    • After the forced update, the system restarts your cluster. During the restart, the services running on the cluster may be unstable.
    • If you do not select Forced Update, the system uses the default mode to restart your cluster to make the changes take effect. For more information, see Restart a cluster or node.
  6. Read the terms of service, select Elasticsearch Terms of Service, and then click Buy Now.
    After you complete the payment, the system restarts the cluster to make the changes take effect.

FAQ