Alibaba Cloud Elasticsearch clusters support three management architectures: Basic Management (v1), Basic Management (v2), and Cloud-native Management (v3). The v3 architecture offers significant optimizations and improvements in feature development, system stability, and security. To access more powerful features and a better service experience, we recommend upgrading your v1/v2 architecture instances to the v3 architecture soon.
Scope
-
Version: The upgrade supports same-version migration across architectures. For example, a v2 architecture instance running version 5.5 remains on version 5.5 after being upgraded to the v3 architecture.
-
Upgrade method: Instances with a v1/v2 architecture can be upgraded to the v3 architecture manually or automatically.
-
Instance type limitations: The upgrade is not supported for v1/v2 architecture instances with the following specifications:
1-core 2 GB,2-core 2 GB,4-core 4 GB,8-core 8 GB,12-core 12 GB, or16-core 16 GB. -
Region limitations: Upgrades are supported only within the same region. The source (v1/v2) and target (v3) instances must be in the same region.
-
Feature limitations: The upgrade is not supported if the v1/v2 architecture instance has any of the following features enabled:
-
Core features: cross-cluster replication (CCR), , inter-instance network connectivity, high availability (HA), application performance management (APM), or Logstash.
-
Extended features: Elastic scaling (such as auto-scaling) or Nginx reverse proxy.
-
Storage features: OpenStore (Log Enhanced Edition) is enabled or local disks are used.
-
Basic requirements: X-Pack is not enabled.
-
Zone: The primary zone is not on the list of zones supported by the v3 architecture.
-
-
Operation limitations: All instance modification operations are prohibited during the upgrade. Make the necessary operational preparations in advance.
-
Upgrade process and duration:
-
The upgrade is performed as a blue-green deployment during a scheduled maintenance window. The cluster topology temporarily displays double the number of nodes. No extra fees are incurred.
-
The upgrade duration is proportional to the data volume and typically lasts several hours. The old nodes are taken offline during your specified maintenance window. This process causes a brief service interruption of 1 to 2 seconds.
-
Manual upgrade
Log on to the Alibaba Cloud Elasticsearch console and use the online migration tool to upgrade a v1/v2 architecture instance to the v3 architecture. Contact technical support to request access to the tool.
Step 1: Create upgrade task
-
Go to the online upgrade page.
Log on to the Alibaba Cloud Elasticsearch console.
-
In the navigation pane on the left, choose .
-
Click Create to create an upgrade task and configure its parameters.
Parameter
Description
Type
Select Architecture Upgrade for Alibaba Cloud Elasticsearch Cluster to upgrade a v1/v2 architecture instance to the v3 architecture and complete data migration.
Cluster
Select the v1/v2 architecture instance that you want to upgrade in the target region.
-
Click OK to create the task.
Step 2: Configure and run upgrade task
In this step, follow the on-screen instructions to configure the upgrade task and complete the data migration.
-
Upgrade check and merge configuration.
On the Configure Source and Destination Clusters tab, follow these steps to perform a feasibility check for the upgrade task and configure the merge.
-
Feasibility check: Before you perform the upgrade, the system automatically checks the health and security of the source cluster to ensure that the upgrade is safe and feasible.
Note-
If the source cluster is unhealthy or the cluster watermark is too high, we recommend that you do not perform the upgrade.
-
If X-Pack is not enabled for the source cluster, the upgrade is not supported.
If the feasibility check fails, modify the configurations as prompted.
-
-
Configure merge: The system automatically detects the configuration parameters of the source cluster, such as the number of replica shards, sharding policies, and user permissions. Then, it creates a target cluster based on this configuration, ensuring that parameters, resources, and policies are synchronized for a smooth upgrade.
NoteThis step takes about 20 minutes.
-
-
Data migration.
On the Migrate Data tab, follow the steps shown in the following figure to complete the cluster merge, replica migration, master node migration, and primary shard migration in sequence.
Actions
Description
Description
Cluster merge
The source and target clusters are merged into a single, larger cluster. After the merge, the
total number of nodes in the cluster = number of nodes in the source cluster + number of nodes in the target cluster.After the cluster merge, Kibana for the target cluster is temporarily disabled. During data migration, you can continue to use the source cluster's Kibana until the service switchover is complete.
Replica migration
The system migrates index replica shards from the source cluster nodes to the target cluster nodes.
If a failure occurs or services are affected during replica migration, you can roll back the operation. After a rollback, the upgrade task fails, and you must create a new one.
Master node migration
The system migrates the master node in the merged cluster from the source cluster to the target cluster.
This change takes effect immediately once the migration begins and cannot be rolled back. Proceed with caution.
NoteFor instances of version
7.xand later, the master node is automatically switched to a node in the target cluster. For instances of versions5.xand6.x, which do not support automatic switching, the new node is promoted to the master node only after the network isolation is complete and the old node goes offline.Primary shard migration
The system migrates the primary shards that store the original data from the source cluster nodes to the target cluster nodes.
After primary shard migration starts, the operation cannot be rolled back. Proceed with caution.
-
Network isolation.
On the Switch Business tab, follow the on-screen instructions to initiate a network isolation request. This prevents the nodes of the source cluster from joining the target cluster. The source cluster stops providing services, and the target cluster takes over.
-
Upgrade completion.
After network isolation is successful, the upgrade task is complete. Click Go to Cluster List to view instance details.
Step 3: Validate data
After the architecture upgrade and data migration are complete, access the target v3 instance from the Kibana console. Run queries and write operations to verify that the cluster works as expected. If you encounter any issues, contact Alibaba Cloud Elasticsearch technical support.
After the Elasticsearch instance architecture is upgraded, the private Kibana endpoint is disabled. You can enable it manually if needed.
Automatic upgrade
The management platform automatically completes the architecture upgrade from v1/v2 to v3 without manual intervention. To access more powerful features and a better service experience, contact technical support to complete the upgrade as soon as possible.