Elasticsearch allows you to monitor clusters and customize alert thresholds. If an alert is detected, you are notified of the alert through SMS messages. To ensure the stability of your Elasticsearch cluster, we recommend that you configure monitoring and alerting to monitor items in real time, such as cluster status and disk usage, check the SMS messages in time, and take measures in advance.

Background information

Elasticsearch allows you to configure monitoring and alerting for the metrics that are described in the following table.
Monitoring metric Description
ClusterStatus Required. This metric checks the cluster status. Green indicates that an Elasticsearch cluster is in normal status. Yellow and red indicate that an Elasticsearch cluster is in abnormal status.
NodeDiskUtilization(%) Required. Set the threshold to a value that is less than 75%. The upper limit is 80%.
NodeHeapMemoryUtilization(%) Required. Set the threshold to a value that is less than 85%. The upper limit is 90%.
NodeCPUUtilization(%) Optional. Set the threshold to a value that is less than or equal to 95%.
NodeLoad_1m Optional. Set the threshold to a value that is 80% of the number of CPU cores per node.
ClusterQueryQPS(Count/Second) Optional. Set the threshold based on the actual test result.
ClusterIndexQPS(Count/Second) Optional. Set the threshold based on the actual test result.
Note The monitoring and alerting feature is enabled for your Elasticsearch cluster by default. You can view historical monitoring data on the Cluster Monitoring page of your cluster. Only monitoring information that is generated in the last one month is displayed.

Procedure

  1. Go to the Elasticsearch page in CloudMonitor.
    You can open the required page by using one of the following methods:
    • From the Elasticsearch console
      1. Log on to the Alibaba Cloud Elasticsearch console.
      2. In the top navigation bar, select the region where your Alibaba Cloud Elasticsearch cluster resides.
      3. Find the target cluster and click its ID.
      4. On the Basic Information page, click Cluster Monitoring in the upper-right corner.
    • From the CloudMonitor console
      1. Log on to the CloudMonitor console. In the left-side navigation pane, click Cloud Service Monitoring. Then, click Elasticsearch.
      2. Select the region where your cluster is deployed.
      3. On the Instances tab, find the target cluster and click its ID in the Instance ID column.
  2. In the upper-right corner, click Alarm Rules.
  3. On the Alarm Rules page, click Create Alarm Rule.
    The following figures provide examples of how to create alert rules for NodeDiskUtilization(%), ClusterStatus, and NodeHeapMemoryUtilization(%).
    Figure 1. Related Resource
    Related Resource
    Figure 2. Set Alarm Rules
    Set Alarm Rules
    • The values for cluster states Green, Yellow, and Red are 0.0, 1.0, and 2.0. Reference these values and set a suitable threshold for the ClusterStatus metric.
    • The Mute for parameter specifies the intervals at which an alert notification is re-sent when a threshold is reached.
      Note For more information about other parameters, see Alarm rule parameters.
  4. In the Notification Method section, select Default Contact Group from the Contact Group section and click the rightwards arrow to add it to the Selected Groups section.
    If you do not have an alert group, click Quickly create a contact group to create a group.Quickly create a contact group
    Note In the HTTP CallBack field, enter a URL that can be accessed from the Internet. CloudMonitor sends a POST request to push the alert notification to this URL. Only HTTP is supported.
  5. Click Confirm.
    After the configurations are complete, the system starts to monitor your Elasticsearch cluster and displays the monitoring data.