This topic provides an overview of the monitoring for the Hive service.

Prerequisites

A Hadoop cluster is created. For more information, see Create a cluster.

Go to the HIVE Monitoring page

  1. Log on to the Alibaba Cloud EMR console.
  2. In the top navigation bar, select the region where your cluster resides and select a resource group based on your business requirements.
  3. Click the Monitor tab.
  4. In the left-side navigation pane, click Cluster Monitoring.
  5. On the Cluster Status page, find the cluster whose monitoring data you want to view, and click Details in the Action column.
  6. In the left-side navigation pane, choose Service Monitoring > Hive.

    The HIVE Monitoring page appears.

HIVE Monitoring page

The HIVE Monitoring page displays basic metric charts, recent alerts and exceptions, and information of processes such as MetaStore and HiveServer2. The information of these processes supports playback.

Hive_overview
  • Basic metric charts: This section displays the Alerts (Today), MetaStore, HiveServer2, and File Descriptor charts.
  • Alerts and Details: This section displays critical exception events related to the Hive service on the current day.
  • MetaStore: This section displays the latest status of the MetaStore process.
    Parameter Description
    Instance Name The name of the instance where the MetaStore process runs. You can click the name to view monitoring details.
    Port Status The port status of the MetaStore process. Green indicates that the port is normal. Red indicates that the port is abnormal.
    Process CPU Usage The CPU utilization of the MetaStore process.
    Heap Memory The heap memory usage of the MetaStore process. The heap memory usage items include Heap Used, Heap Committed, Heap Max, and Heap Init.
    Non-Heap Memory The non-heap memory usage of the MetaStore process. The non-heap memory usage items include NonHeap Used, NonHeap Committed, and NonHeap Init.
    JVM Garbage Collection Statistics
    • S0: the capacity usage of survivor space 1 (%)
    • S1: the capacity usage of survivor space 2 (%)
    • O: the capacity usage of the old generation space (%)
    • E: the capacity usage of the Eden space (%)
    • M: the capacity usage of the metaspace (%)
    • CCS: the capacity usage of the Compressed Class Space (%)
    • YGCT: the time consumed by garbage collection in the young generation space
    • FGCT: the time consumed by garbage collection in the old generation space
    • GCT: the total time consumed by garbage collection
    • YGC: the number of times garbage collection is performed in the young generation space
    • FGC: the number of times garbage collection is performed in the old generation space
  • HiveServer2: This section displays the latest status of the HiveServer2 process.

    For information about the parameters in this section, see Parameter description for MetaStore.

Monitoring details page for MetaStore

On the HIVE Monitoring page, you can click the name in the MetaStore section to go to the monitoring details page for the MetaStore process.

  • MetaStore Process JVM Indicators: This section displays the MetaStore Process Memory Usage, MetaStore Process Garbage Collection Time, MetaStore Process Garbage Collections, Heap Memory, and Non-Heap Memory charts.
  • MetaStore Process File Descriptor: This section displays the maximum number of file descriptors that the MetaStore process can use and the number of file descriptors that are in use.
  • MetaStore Threads: This section displays the number of threads in each mode for the MetaStore process.
  • MetaStore Process History.
    Parameter Description
    Date The time when an operation is performed.
    Start/Restart/Stop The operation type, which can be start, stop, or restart.
    Auto Resume Indicates whether an operation is automatically resumed by the keepalive mechanism of EMR. The EMR agent automatically resumes components that exit abnormally to ensure service availability.
    Started By The Linux user who performs an operation. This parameter is left empty for a process in the Stop state.
    PID The ID of a process generated in an operation. This parameter is left empty for a process in the Stop state.
    PPID The ID of a parent process generated in an operation. This parameter is left empty for a process in the Stop state.
    Startup Parameters The detailed start parameters for a process generated in an operation. This parameter is left empty for a process in the Stop state.

Monitoring details page for HiveServer2

On the HIVE Monitoring page, you can click the name in the HiveServer2 section to go to the monitoring details page for the HiveServer2 process.

  • HiveServer2 Process JVM Indicators: This section displays the HiveServer2 Process Memory Usage, HiveServer2 Process Garbage Collection Time, HiveServer2 Process Garbage Collections, Heap Memory, and Non-Heap Memory charts.
  • HiveServer2 Process File Descriptor: This section displays the maximum number of file descriptors that the HiveServer2 process can use and the number of file descriptors that are in use.
  • HiveServer2 Threads: This section displays the number of threads in each mode for the HiveServer2 process.
  • HiveServer2 Process History.
    Parameter Description
    Date The time when an operation is performed.
    Start/Restart/Stop The operation type, which can be start, stop, or restart.
    Auto Resume Indicates whether an operation is automatically resumed by the keepalive mechanism of EMR. The EMR agent automatically resumes components that exit abnormally to ensure service availability.
    Started By The Linux user who performs an operation. This parameter is left empty for a process in the Stop state.
    PID The ID of a process generated in an operation. This parameter is left empty for a process in the Stop state.
    PPID The ID of a parent process generated in an operation. This parameter is left empty for a process in the Stop state.
    Startup Parameters The detailed start parameters for a process generated in an operation. This parameter is left empty for a process in the Stop state.