This topic provides an overview of the monitoring for the Hive service.

Prerequisites

A Hadoop cluster is created.

Enter the HIVE Monitoring page

  1. Log on to the Alibaba Cloud E-MapReduce console.
  2. Click the Monitor tab.
  3. In the left-side navigation pane, click Cluster Monitoring.
  4. On the Cluster Status page, click Details in the Action column that corresponds to the Hadoop cluster.
  5. In the left-side navigation pane, choose Service Monitoring > Hive to enter the HIVE Monitoring page.

HIVE Monitoring page

The HIVE Monitoring page displays basic metric charts, recent alerts and exceptions, and information of processes such as MetaStore and HiveServer2. The information of these processes supports playback.

HIVE Monitoring page
  • Basic metric charts. This section includes Alerts (Today), MetaStore, HiveServer2, and File Descriptor by default.
  • Alerts and Details. This section displays critical exception events related to the Hive service on the current day.
  • MetaStore. This section displays the latest status of the MetaStore process.
    Parameter Description
    Instance Name The name of the MetaStore process. Click the name to view monitoring details.
    Port Status The port status of the MetaStore process. Green indicates that the port is normal. Red indicates that the port is abnormal.
    Process CPU Usage The CPU utilization of the MetaStore process.
    Heap Memory The heap memory usage of the MetaStore process. The heap memory usage items include Heap Used, Heap Committed, Heap Max, and Heap Init.
    Non-Heap Memory The non-heap memory usage of the MetaStore process. The non-heap memory usage items include NonHeap Used, NonHeap Committed, and NonHeap Init.
    JVM Garbage Collection Statistics
    • S0: the capacity usage of survivor space 1 (%)
    • S1: the capacity usage of survivor space 2 (%)
    • O: the capacity usage of the old generation space (%)
    • E: the capacity usage of the Eden space (%)
    • M: the capacity usage of the metaspace (%)
    • CCS: the capacity usage of the Compressed Class Space (%)
    • YGCT: the time consumed by garbage collection in the young generation space
    • FGCT: the time consumed by garbage collection in the old generation space
    • GCT: the total time consumed by garbage collection
    • YGC: the number of times garbage collection is performed in the young generation space
    • FGC: the number of times garbage collection is performed in the old generation space
  • HiveServer2. This section displays the latest status of the HiveServer2 process.

    For information about parameters, see parameter description for MetaStore.

Monitoring details page for MetaStore

On the HIVE Monitoring page, you can click the name in the MetaStore section to enter the monitoring details page for the MetaStore process.

  • MetaStore Process JVM Indicators. This section includes MetaStore Process Memory Usage, MetaStore Process Garbage Collection Time, MetaStore Process Garbage Collections, Heap Memory, and Non-Heap Memory.
  • MetaStore Process File Descriptor. This section displays the maximum number of file descriptors that the MetaStore process can use and the number of file descriptors that are in use.
  • MetaStore Threads. This section displays the number of threads in each mode for the MetaStore process.
  • MetaStore Process History.
    Parameter Description
    Date The time when an operation is performed.
    Start/Restart/Stop The operation type, which can be start, stop, or restart.
    Auto Resume Whether an operation is automatically resumed by the keepalive mechanism of EMR. The EMR agent automatically resumes components that exit abnormally to ensure service availability.
    Started By The Linux user who performs an operation. This parameter is left empty for a process in the Stop state.
    PID The ID of a process generated in an operation. This parameter is left empty for a process in the Stop state.
    PPID The ID of a parent process generated in an operation. This parameter is left empty for a process in the Stop state.
    Startup Parameters The detailed start parameters for a process generated in an operation. This parameter is left empty for a process in the Stop state.

Monitoring details page for HiveServer2

On the HIVE Monitoring page, you can click the name in the HiveServer2 section to enter the monitoring details page for the HiveServer2 process.

  • HiveServer2 Process JVM Indicators. This section includes HiveServer2 Process Memory Usage, HiveServer2 Process Garbage Collection Time, HiveServer2 Process Garbage Collections, Heap Memory, and Non-Heap Memory.
  • HiveServer2 Process File Descriptor. This section displays the maximum number of file descriptors that the HiveServer2 process can use and the number of file descriptors that are in use.
  • HiveServer2 Threads. This section displays the number of threads in each mode for the HiveServer2 process.
  • HiveServer2 Process History.
    Parameter Description
    Date The time when an operation is performed.
    Start/Restart/Stop The operation type, which can be start, stop, or restart.
    Auto Resume Whether an operation is automatically resumed by the keepalive mechanism of EMR. The EMR agent automatically resumes components that exit abnormally to ensure service availability.
    Started By The Linux user who performs an operation. This parameter is left empty for a process in the Stop state.
    PID The ID of a process generated in an operation. This parameter is left empty for a process in the Stop state.
    PPID The ID of a parent process generated in an operation. This parameter is left empty for a process in the Stop state.
    Startup Parameters The detailed start parameters for a process generated in an operation. This parameter is left empty for a process in the Stop state.