All Products
Search
Document Center

Elasticsearch:Configure nodes for an Alibaba Cloud Elasticsearch cluster

Last Updated:Jan 16, 2024

This topic describes the features of each type of node for an Alibaba Cloud Elasticsearch cluster and provides instructions on how to configure node-related parameters when you purchase an Alibaba Cloud Elasticsearch cluster.

Data node

Data nodes are used to store indexes. You can use data nodes to add, remove, modify, search for, or aggregate documents in indexes. Data nodes have high CPU, memory, and I/O requirements. When you optimize the performance of a cluster, you must monitor the statuses of the data nodes in the cluster. If the resources of the cluster are insufficient, we recommend that you add data nodes to the cluster.

Note
  • If dedicated master nodes are purchased, data nodes are used only as data nodes.

  • If dedicated master nodes are not purchased, data nodes are also used as dedicated master nodes.

Parameter

Description

Data Node Type

We recommend that you use data nodes with 2 vCPUs and 4 GiB of memory in testing environments and use data nodes with higher specifications in production environments.

Data Node Disk Type

  • ESSD (default): This type of disk features low latency, quick response, and high data throughput and is suitable for latency-sensitive applications or I/O intensive business scenarios. For more information about the specifications of ESSDs, see Node specifications. For more information about the performance of ESSDs, see ESSDs.

  • Ultra Disk: This type of disk is cost-effective and suitable for logging and analyzing large volumes of data.

  • Standard SSD: This type of disk is suitable for online data analytics and searches that require high IOPS and quick responses.

Note
  • You can view the supported disk types on the buy page.

  • After a cluster is created, you cannot change the disk types of nodes in the cluster.

Performance Level

If you set the Data Node Disk Type parameter to ESSD, you need to configure this parameter.

Data Node Disk Encryption

  • Disk encryption offers the maximum data security without requiring you to make additional changes to your businesses and applications. However, disk encryption may have a small impact on the performance of your cluster.

  • Disk encryption is free of charge. No additional fees are generated when you read data from or write data to encrypted disks.

Note
  • You cannot disable disk encryption for encrypted disks.

  • You cannot enable disk encryption for purchased disks. When you upgrade the configuration of a cluster, you cannot enable disk encryption for purchased disks. If you purchase cloud disks when you upgrade the configuration of the cluster, you can enable disk encryption.

Data Node Storage Space

The storage space of each data node depends on the disk type. Unit: GiB.

  • ESSD: The maximum value of this parameter is 6144.

  • Ultra Disk: For a cluster of V6.7, V7.7, or a version later than V7.7, the maximum value of this parameter is 20480. For a cluster of another version, the maximum value of this parameter is 5120.

  • Standard SSD: For a cluster of V6.7, V7.7, or a version later than V7.7, the maximum value of this parameter is 6144. For a cluster of another version, the maximum value of this parameter is 2048.

Note

When you resize an ultra disk with a storage space greater than 2,560 GiB, only a blue-green update can be performed for the ultra disk because the disk is designed to run in disk arrays or RAID 0.

Data Nodes

The number of nodes that you purchase must be a multiple of the number of zones.

Important

A cluster that contains only two data nodes has high split-brain risks and delivers low stability. Therefore, you must configure this parameter based on your business requirements.

Kibana node

  • The value of the Kibana Node parameter can be only Yes.

  • A Kibana node with 1 vCPU and 2 GiB of memory is free of charge. However, we recommend that you use the Kibana node with 1 vCPU and 2 GiB of memory only for testing purposes.

  • Due to the impact on cluster performance and stability, we recommend that you purchase a Kibana node with 2 vCPUs and 4 GiB of memory or higher specifications.

Dedicated master node

You can use dedicated master nodes to perform operations on clusters, such as creating indexes, deleting indexes, tracking nodes, and allocating shards. The stability of dedicated master nodes is important to the health of clusters. By default, each node in a cluster may be used as a dedicated master node. Operations, such as data indexing, searches, and queries, require a large number of CPU, memory, and I/O resources. To ensure the stability of a cluster, we recommend that you purchase dedicated master nodes to separate the dedicated master nodes from data nodes.

Important

If the dedicated master nodes in your cluster are free of charge, you are charged for these nodes after you upgrade the configuration of the cluster.

Parameter

Description

Dedicated Master Node

  • To improve the stability of your services, we recommend that you purchase dedicated master nodes.

  • For a multi-zone Elasticsearch cluster, the default value of this parameter is Yes, and you cannot change the value.

Note
  • You cannot release the dedicated master nodes that you have purchased.

  • After a cluster is created, you can purchase dedicated master nodes when you upgrade the configuration of the cluster.

Dedicated Master Node Type

You can view the supported specifications on the buy page.

Dedicated Master Node Disk Type

  • ESSD (default): This type of disk features low latency, quick response, and high data throughput and is suitable for latency-sensitive applications or I/O intensive business scenarios. For more information about the specifications of ESSDs, see Node specifications. For more information about the performance of ESSDs, see ESSDs.

  • Ultra Disk: This type of disk is cost-effective and suitable for logging and analyzing large volumes of data.

  • Standard SSD: This type of disk is suitable for online data analytics and searches that require high IOPS and quick responses.

You can view the supported disk types on the buy page.

Dedicated Master Node Storage Space

The value of this parameter can be only 20G.

Dedicated Master Nodes

The value of this parameter can be only 3.

Warm node

If your business involves both of the following index types, we recommend that you purchase warm nodes to implement the hot-warm architecture. This architecture improves the processing performance and service stability of a cluster.

  • Frequently queried or written indexes

  • Infrequently queried or written indexes, typically indexes of records

For more information, see "Hot-Warm" Architecture in Elasticsearch 5.x.

Note

If dedicated master nodes are purchased, warm nodes are used only as warm nodes.

If dedicated master nodes are not purchased, warm nodes are also used as dedicated master nodes.

Parameter

Description

Warm Node

You cannot release the warm nodes that you have purchased.

Warm Node Type

You can view the supported specifications on the buy page.

Warm Node Disk Type

The value of this parameter can be only Ultra Disk.

Warm Node Disk Encryption

  • Disk encryption offers the maximum data security without requiring you to make additional changes to your businesses and applications. However, disk encryption may have a small impact on the performance of your cluster.

  • Disk encryption is free of charge. No additional fees are generated when you read data from or write data to encrypted disks.

Note
  • You cannot disable disk encryption for encrypted disks.

  • You cannot enable disk encryption for purchased disks. When you upgrade the configuration of a cluster, you cannot enable disk encryption for purchased disks. If you purchase cloud disks when you upgrade the configuration of the cluster, you can enable disk encryption.

Warm Node Storage Space

The minimum value of this parameter is 500. Unit: GiB.

Warm Nodes

The number of nodes that you purchase must be a multiple of the number of zones.

After you purchase data nodes and warm nodes, the system adds -Enode.attr.box_type to the startup parameters of the nodes.

Node type

Startup parameter

Data node

-Enode.attr.box_type=hot

Warm node

-Enode.attr.box_type=warm

Client node

You can purchase client nodes to share the CPU overheads of data nodes. This improves the processing performance and service stability of a cluster. For CPU-intensive services, such as services that require a large number of aggregate queries, we recommend that you purchase client nodes.

Parameter

Description

Client Node

You cannot release the client nodes that you have purchased for a cluster that is deployed in the cloud-native control architecture (a cluster of V7.16 or later). You can check whether you can release the client nodes in your cluster on the buy page.

Client Node Type

You can view the supported specifications on the buy page.

Client Node Disk Type

The value of this parameter can be only Ultra Disk.

Client Node Storage Space

The value of this parameter can be only 20G.

Client Nodes

The number of nodes that you purchase must be a multiple of the number of zones.

References