You can use various methods to manage your Alibaba Cloud Elasticsearch clusters. This topic provides an overview of best practices for cluster management to meet your business requirements in various scenarios.
|Separate hot and cold data||
An Alibaba Cloud Elasticsearch cluster that uses the hot-warm architecture contains hot nodes and warm nodes. This architecture improves the performance and stability of the cluster.
When you use this type of cluster, you can separate hot and cold data to improve the efficiency of data queries and reduce the storage costs of historical data.
|Use ILM to manage Heartbeat indexes||Time series data increases over time. You can use the index lifecycle management (ILM) feature to periodically roll over the data to new indexes. This ensures high query efficiency and reduces query costs. As indexes age and fewer queries are required, you can migrate the indexes to a less expensive disk and reduce the numbers of primary and replica shards.|
|Use ILM to separate hot data from cold data||When you use an Alibaba Cloud Elasticsearch cluster, you can use the ILM feature to separate hot data from cold data in the cluster. This improves the read/write performance of the cluster, automates the maintenance of hot and cold data, and reduces your production costs.|
|Use the CCR feature to migrate data||You can use the cross-cluster replication (CCR) feature to migrate index data between a local Alibaba Cloud Elasticsearch cluster and a remote Alibaba Cloud Elasticsearch cluster. This feature helps implement high availability and disaster recovery for your Alibaba Cloud Elasticsearch cluster. You can also use the feature for cross-region data access from a nearby cluster.|
|Use the rollup mechanism to summarize traffic data||Time series data increases over time. If you want to store large volumes of data in your Alibaba Cloud Elasticsearch cluster, the storage costs will linearly increase. You can use the rollup mechanism of Elasticsearch to store data at a fraction of the cost.|
|Use Curator||Curator is an index management tool provided by open source Elasticsearch. This tool allows you to create, delete, and disable indexes. It also allows you to merge index segments.|
|Integrate X-Pack with LDAP||When you use an Alibaba Cloud Elasticsearch cluster, you can configure Lightweight Directory Access Protocol (LDAP) authentication for the cluster to allow LDAP users with the required roles to access the cluster.|
|Use the RBAC mechanism provided by Elasticsearch X-Pack to implement access control||If you want to configure access permissions on objects such as Alibaba Cloud Elasticsearch clusters, indexes, and fields, you can use the role-based access control (RBAC) mechanism that is provided by the X-Pack plug-in of Elasticsearch. This mechanism allows you to grant permissions to custom roles and assign the roles to users for access control. Elasticsearch provides a variety of built-in roles. You can create custom roles based on the built-in roles to meet specific requirements.|
|Use Terraform to manage Alibaba Cloud Elasticsearch clusters||Terraform allows you to use code to allocate resources such as physical machines. You can use Terraform to write a configuration file to purchase a cloud server or apply for resources, such as the resources of the Alibaba Cloud Elasticsearch and Object Storage Service (OSS) services. You can use Terraform to manage your Alibaba Cloud Elasticsearch clusters. For example, you can use Terraform to create, update, view, or delete a cluster.|
|Use Cerebro to access an Elasticsearch cluster||In addition to Kibana, curl commands, and clients, you can use third-party plug-ins or tools such as Elasticsearch-Head and Cerebro to access an Alibaba Cloud Elasticsearch cluster.|