monitoring log - Elasticsearch - Alibaba Cloud Documentation Center

By default, the X-Pack monitoring client collects cluster monitoring data every 10 seconds and saves it to indexes whose names start with .monitoring-*. These indexes roll over daily. Over time, monitoring indexes can consume large amounts of disk space and affect normal instance operation. You can control disk usage by adjusting the retention policy and collection scope for monitoring indexes.

Procedure

Before you begin, log on to the Kibana console. For more information, see Connect to a cluster using Kibana.

The steps in this topic use Alibaba Cloud Elasticsearch V6.7.0 as an example. The interface labels in other versions may vary slightly. Use the labels shown in your actual interface.

Check the disk space used by monitoring indexes.
1. In the Kibana console, click the icon in the upper-left corner to expand the navigation pane on the left. Then click Management, and click Stack Monitoring.
2. In the Elasticsearch section, click Indices.
3. On the Indices tab, turn on System indices to view the disk space used by monitoring indexes (.monitoring-es-* and .monitoring-kibana-*). The .monitoring-es-* indexes use the most space. They store cluster status, cluster statistics, node statistics, and index statistics.
Configure monitoring indexes. By default, system monitoring indexes retain data for the last seven days. Their size depends on the number of indexes (including system indexes) and the number of nodes in the cluster. Use one or both of the following methods to control disk usage.
1. In the navigation pane on the left, click Dev Tools.
2. Set the index retention duration. On the Console tab, run the following command to set the retention duration to one day. You can adjust this value as needed. The minimum value is one day.
```
PUT _cluster/settings
{"persistent": {"xpack.monitoring.history.duration":"1d"}}
```
3. Specify which indexes to monitor. Run the following command to define the monitoring scope and reduce the disk space used by .monitoring-es-* indexes. This example disables monitoring for system indexes.
```
PUT _cluster/settings
{"persistent": {"xpack.monitoring.collection.indices": "*,-.*"}}
```
  Monitoring data for excluded indexes does not appear on the Monitoring page in Kibana. However, you can still view the index list and status by running GET _cat/indices.