E-MapReduce Doctor (EMR Doctor) is an intelligent diagnostic system for open-source big data clusters. Use the Monitoring and Diagnostics and Monitoring and Diagnostics features on the Monitoring and Diagnostics page to monitor cluster health, track trends, and guide operational decisions and resource optimization.
When managing an EMR cluster, you typically need to monitor:
-
Cluster stability, including status monitoring and exception handling for key services such as YARN, HDFS, Hive, and Spark.
-
Cluster effectiveness, including workload and memory and CPU utilization.
-
Service level agreements (SLAs) for cluster users, ensuring critical tasks have sufficient resources to complete on time.
EMR Doctor provides the following capabilities:
-
Provides timely updates on cluster health status and recommends actions for key services to reduce operational costs and improve stability.
-
Tracks resource usage and allocation to help you right-size hardware and improve utilization.
-
Suggests optimizations for component and workload tuning to keep your data pipeline efficient and stable.
Key features:
-
Runs in-depth diagnostics on a cluster or node and displays detected issues with recommended fixes. For more information, see Enable Health Check.
-
Generates a cluster report with a quantitative score and targeted recommendations for potential improvements. For more information, see View and analyze cluster daily reports.
-
Applies intelligent algorithms to cluster data, reducing the repetitive manual effort of big data platform management.