When you create an E-MapReduce (EMR) cluster, the service components that are deployed on cluster nodes vary based on the cluster type. For example, the NameNode component of the HDFS service is deployed on the master node of a Hadoop cluster. This topic describes how to view the deployment information of service components on each node of an EMR cluster.

Prerequisites

An EMR cluster is created. For more information, see Create a cluster.

Procedure

  1. Go to the Cluster Overview page of your cluster.
    1. Log on to the Alibaba Cloud EMR console.
    2. In the top navigation bar, select the region where your cluster resides and select a resource group based on your business requirements.
    3. Click the Cluster Management tab.
    4. Find your cluster and click Details in the Actions column.
  2. In the left-side navigation pane, click Cluster Service and select the service whose component deployment information you want to view.
  3. On the page that appears, click the Component Deployment tab.
    The deployment information is displayed on the Component Deployment tab. The following sections provide the deployment information of each cluster type:

Hadoop cluster

The following tables provide the deployment information of service components on each node of a Hadoop cluster of EMR V3.29.0.
  • Required services
    Service Component on the master node Component on the core nodes
    HDFS
    • KMS
    • SecondaryNameNode
    • HttpFS
    • HDFS Client
    • NameNode
    • DataNode
    • HDFS Client
    YARN
    • ResourceManager
    • App Timeline Server
    • JobHistory
    • WebAppProxyServer
    • Yarn Client
    • Yarn Client
    • NodeManager
    Hive
    • Hive MetaStore
    • HiveServer2
    • Hive Client
    Hive Client
    Spark
    • Spark Client
    • SparkHistory
    • ThriftServer
    Spark Client
    Knox Knox N/A
    Tez
    • Tomcat
    • Tez Client
    Tez Client
    Ganglia
    • Gmond
    • Httpd
    • Gmetad
    • Ganglia Client
    • Gmond
    • Ganglia Client
    Sqoop Sqoop Client Sqoop Client
    Bigboot
    • Bigboot Client
    • Bigboot Monitor
    • Bigboot Client
    • Bigboot Monitor
    OpenLDAP OpenLDAP N/A
    Hue Hue N/A
    SmartData
    • Jindo Namespace Service
    • Jindo Storage Service
    • Jindo Client
    • Jindo Storage Service
    • Jindo Client
  • Optional services
    Service Component on the master node Component on the core nodes
    LIVY Livy N/A
    Superset Superset N/A
    Flink
    • FlinkHistoryServer
    • Flink Client
    Flink Client
    RANGER
    • RangerPlugin
    • RangerAdmin
    • RangerUserSync
    • Solr
    RangerPlugin
    Storm
    • Storm Client
    • UI
    • Nimbus
    • Logviewer
    • Storm Client
    • Supervisor
    • Logviewer
    Phoenix Phoenix Client Phoenix Client
    Kudu
    • Kudu Master
    • Kudu Client
    • Kudu Tserver
    • Kudu Master
    • Kudu Client
    HBase
    • HMaster
    • HBase Client
    • ThriftServer
    • HBase Client
    • HRegionServer
    ZooKeeper
    • ZooKeeper follower
    • ZooKeeper Client
    • ZooKeeper follower
    • ZooKeeper leader
    • ZooKeeper Client
    Oozie Oozie N/A
    Presto
    • Presto Client
    • PrestoMaster
    • Presto Client
    • PrestoWorker
    Impala
    • Impala Runtime and Shell
    • Impala Catalog Server
    • Impala StateStore Server
    • Impala Runtime and Shell
    • Impala Daemon Server
    Pig Pig Client Pig Client
    Zeppelin Zeppelin N/A
    FLUME
    • Flume Agent
    • Flume Client
    • Flume Agent
    • Flume Client

Druid cluster

The following tables provide the deployment information of service components on each node of a Druid cluster of EMR V3.29.0.
  • Required services
    Service Component on the master node Component on the core nodes
    Druid
    • Druid Client
    • Coordinator
    • Overlord
    • Broker
    • Router
    • MiddleManager
    • Historical
    • Druid Client
    HDFS
    • KMS
    • SecondaryNameNode
    • HttpFS
    • HDFS Client
    • NameNode
    • DataNode
    • HDFS Client
    Ganglia
    • Gmond
    • Httpd
    • Gmetad
    • Ganglia Client
    • Gmond
    • Ganglia Client
    ZooKeeper
    • ZooKeeper follower
    • ZooKeeper Client
    • ZooKeeper leader
    • ZooKeeper follower
    • ZooKeeper Client
    OpenLDAP OpenLDAP N/A
    Bigboot
    • Bigboot Client
    • Bigboot Monitor
    • Bigboot Client
    • Bigboot Monitor
    SmartData
    • Jindo Namespace Service
    • Jindo Storage Service
    • Jindo Client
    • Jindo Storage Service
    • Jindo Client
  • Optional services
    Service Component on the master node Component on the core nodes
    YARN
    • ResourceManager
    • App Timeline Server
    • JobHistory
    • WebAppProxyServer
    • Yarn Client
    • Yarn Client
    • NodeManager
    Superset Superset N/A

Dataflow-Kafka cluster

The following tables provide the deployment information of service components on each node of a Dataflow-Kafka cluster of EMR V3.29.0.
  • Required services
    Service Component on the master node Component on the core nodes
    Kafka-Manager Kafka Manager N/A
    Kafka
    • Kafka Client
    • KafkaMetadataMonitor
    • Kafka Rest Proxy
    • Kafka Broker broker
    • Kafka Schema Registry
    • Kafka Broker broker
    • Kafka Client
    Ganglia
    • Gmond
    • Httpd
    • Gmetad
    • Ganglia Client
    • Gmond
    • Ganglia Client
    ZooKeeper
    • ZooKeeper follower
    • ZooKeeper Client
    • ZooKeeper leader
    • ZooKeeper follower
    • ZooKeeper Client
    OpenLDAP OpenLDAP N/A
  • Optional services
    Service Component on the master node Component on the core nodes
    RANGER
    • RangerPlugin
    • RangerUserSync
    • RangerAdmin
    • Solr
    RangerPlugin
    Knox Knox N/A

Flink cluster

The following tables provide the deployment information of service components on each node of a Flink cluster of EMR V3.30.0.
  • Required services
    Service Component on the master node Component on the core nodes
    HDFS
    • KMS
    • SecondaryNameNode
    • HttpFS
    • HDFS Client
    • NameNode
    • DataNode
    • HDFS Client
    YARN
    • ResourceManager
    • App Timeline Server
    • JobHistory
    • WebAppProxyServer
    • Yarn Client
    • Yarn Client
    • NodeManager
    Ganglia
    • Gmond
    • Httpd
    • Gmetad
    • Ganglia Client
    • Gmond
    • Ganglia Client
    ZooKeeper
    • ZooKeeper
    • ZooKeeper Client
    • ZooKeeper
    • ZooKeeper Client
    Knox Knox N/A
    Flink-Vvp Flink-Vvp N/A
    OpenLDAP OpenLDAP N/A
  • Optional services
    Service Component on the master node Component on the core nodes
    PAI-Alink Alink N/A

Data Science cluster

The following tables provide the deployment information of service components on each node of a Data Science cluster of EMR V3.29.1.
  • Required services
    Service Component on the master node Component on the core nodes
    HDFS
    • HDFS Client
    • KMS
    • HttpFS
    • NameNode
    • SecondaryNameNode
    • HDFS Client
    • DataNode
    YARN
    • WebAppProxyServer
    • JobHistory
    • App Timeline Server
    • ResourceManager
    • Yarn Client
    • NodeManager
    • Yarn Client
    ZooKeeper
    • ZooKeeper Client
    • ZooKeeper follower
    • ZooKeeper Client
    • ZooKeeper leader
    • ZooKeeper follower
    Knox Knox N/A
    Tensorflow on YARN
    • TensorFlow-On-YARN-Gateway
    • TensorFlow-On-YARN-History-Server
    • TensorFlow-On-YARN
    • TensorFlow-On-YARN-Client
    • TensorFlow-On-YARN-Gateway
    SmartData
    • Jindo Namespace Service
    • Jindo Storage Service
    • Jindo Client
    • Jindo Storage Service
    • Jindo Client
    Bigoot
    • Bigboot Monitor
    • Bigboot Client
    • Bigboot Monitor
    • Bigboot Client
    PAI-EASYREC Easyrec Easyrec
    PAI-EAS PAIEAS PAIEAS
    PAI-Faiss Faiss Faiss
    PAI-Redis Redis Redis
    PAI-Alink Alink N/A
    Flink-Vvp Flink-Vvp N/A
    OpenLDAP OpenLDAP N/A
    Jindo SDK Jindo SDK Jindo SDK
  • Optional services
    Service Component on the master node Component on the core nodes
    Zeppelin Zeppelin N/A
    PAI-REC Rec N/A
    AUTOML AUTOML AUTOML
    TensorFlow TensorFlow TensorFlow

ClickHouse cluster

The following table provides the deployment information of service components on each node of a ClickHouse cluster of EMR V3.35.0.
Service Component on the master node Component on the core nodes
Ganglia
  • Gmond
  • Httpd
  • Gmetad
  • Ganglia Client
  • Gmond
  • Ganglia Client
ZooKeeper
  • ZooKeeper Client
  • ZooKeeper follower
  • ZooKeeper Client
  • ZooKeeper leader
  • ZooKeeper follower
ClickHouse
  • ClickHouse Server
  • ClickHouse Client
  • ClickHouse Server
  • ClickHouse Client