This topic uses EMR-3.26.0 as an example to describe the deployment details of service components on each node in different EMR clusters.

Background information

When you create an EMR cluster, different service components are deployed on different categories of nodes. For example, the NameNode component of Hadoop HDFS is deployed on the master node. For more information about node categories, see Node categories. You can use bootstrap actions to complete custom deployment and allocation for large-scale clusters. For example, a stand-alone ZooKeeper cluster uses Alibaba Cloud ApsaraDB for RDS as the Hive metastore.

View deployment details of service components on a cluster

  1. Log on to the Alibaba Cloud E-MapReduce console.
  2. In the top navigation bar, select the region where you want to create a cluster. The region of a cluster cannot be changed after the cluster is created.
  3. In the left-side navigation pane of the Cluster Overview page that appears, click Cluster Service and choose the service for which you want to view deployment details of components.
  4. On the service page that appears, click the Component Deployment tab.

Hadoop clusters

Deployment details of service components that run on a Hadoop cluster
  • Required services
    Service name Master node Core node
    HDFS
    • KMS
    • SecondaryNameNode
    • HttpFS
    • HDFS Client
    • NameNode
    • DataNode
    • HDFS Client
    YARN
    • ResourceManager
    • App Timeline Server
    • JobHistory
    • WebAppProxyServer
    • Yarn Client
    • Yarn Client
    • NodeManager
    Hive
    • Hive MetaStore
    • HiveServer2
    • Hive Client
    		 Hive Client
    Spark
    • Spark Client
    • SparkHistory
    • ThriftServer
    		 Spark Client
    Knox Knox N/A
    Zeppelin Zeppelin N/A
    Tez
    • Tomcat
    • Tez Client
    		 Tez Client
    Ganglia
    • Gmond
    • Httpd
    • Gmetad
    • Ganglia Client
    • Gmond
    • Ganglia Client
    Pig Pig Client Pig Client
    Sqoop Sqoop Client Sqoop Client
    Bigboot
    • Bigboot Client
    • Bigboot Monitor
    • Bigboot Client
    • Bigboot Monitor
    OpenLDAP OpenLDAP N/A
    Hue Hue N/A
    SmartData
    • Jindo Namespace Service
    • Jindo Storage Service
    • Jindo Client
    • Jindo Storage Service
    • Jindo Client
  • Optional services
    Service name Master node Core node
    Flume
    • Flume Agent
    • Flume Client
    • Flume Agent
    • Flume Client
    Livy Livy N/A
    Superset Superset N/A
    Flink
    • FlinkHistoryServer
    • Flink Client
    		 Flink Client
    Ranger
    • RangerPlugin
    • RangerAdmin
    • RangerUserSync
    		 RangerPlugin
    Storm
    • Storm Client
    • UI
    • Nimbus
    • Logviewer
    • Storm Client
    • Supervisor
    • Logviewer
    Phoenix Phoenix Client Phoenix Client
    Analytics Zoo
    • Analytics-Zoo-Scala
    • Analytics-Zoo-Python
    • Analytics-Zoo-Scala
    • Analytics-Zoo-Python
    Kudu
    • Kudu Master
    • Kudu Client
    • Kudu Tserver
    • Kudu Master
    • Kudu Client
    HBase
    • HMaster
    • HBase Client
    • ThriftServer
    • HBase Client
    • HRegionServer
    ZooKeeper
    • ZooKeeper
    • ZooKeeper Client
    • ZooKeeper leader
    • ZooKeeper follower
    • ZooKeeper Client
    Oozie Oozie N/A
    Presto
    • Presto Client
    • PrestoMaster
    • Presto Client
    • PrestoWorker
    Impala
    • Impala Runtime and Shell
    • Impala Catalog Server
    • Impala StateStore Server
    • Impala Runtime and Shell
    • Impala Daemon Server

Druid clusters

Deployment details of service components on a Druid cluster
  • Required services
    Service name Master node Core node
    Druid
    • Druid Client
    • Coordinator
    • Overlord
    • Broker
    • Router
    • MiddleManager
    • Historical
    • Druid Client
    HDFS
    • KMS
    • SecondaryNameNode
    • HttpFS
    • HDFS Client
    • NameNode
    • DataNode
    • HDFS Client
    Ganglia
    • Gmond
    • Httpd
    • Gmetad
    • Ganglia Client
    • Gmond
    • Ganglia Client
    ZooKeeper
    • ZooKeeper follower
    • ZooKeeper Client
    • ZooKeeper leader
    • ZooKeeper follower
    • ZooKeeper Client
    OpenLDAP OpenLDAP N/A
    Bigboot
    • Bigboot Client
    • Bigboot Monitor
    • Bigboot Client
    • Bigboot Monitor
    SmartData
    • Jindo Namespace Service
    • Jindo Storage Service
    • Jindo Client
    • Jindo Storage Service
    • Jindo Client
  • Optional services
    Service name Master node Core node
    YARN
    • ResourceManager
    • App Timeline Server
    • JobHistory
    • WebAppProxyServer
    • Yarn Client
    • Yarn Client
    • NodeManager
    Superset Superset N/A

Kafka clusters

Deployment details of service components on a Kafka cluster
  • Required services
    Service name Master node Core node
    Kafka-Manager Kafka Manager N/A
    Kafka
    • Kafka Client
    • KafkaMetadataMonitor
    • Kafka Rest Proxy
    • Kafka Broker broker
    • Kafka Schema Registry
    • Kafka Broker broker
    • Kafka Client
    Ganglia
    • Gmond
    • Httpd
    • Gmetad
    • Ganglia Client
    • Gmond
    • Ganglia Client
    ZooKeeper
    • ZooKeeper follower
    • ZooKeeper Client
    • ZooKeeper leader
    • ZooKeeper follower
    • ZooKeeper Client
    OpenLDAP OpenLDAP N/A
  • Optional services
    Service name Master node Core node
    Ranger
    • RangerPlugin
    • RangerUserSync
    • RangerAdmin
    		 RangerPlugin
    Knox Knox N/A

ZooKeeper clusters

Deployment details of service components on a ZooKeeper cluster
Service name Master node Core node
Ganglia N/A
  • Gmond
  • Httpd
  • Gmetad
  • Ganglia Client
ZooKeeper N/A
  • ZooKeeper leader
  • ZooKeeper Client
  • ZooKeeper follower

Flink clusters

Deployment details of service components on a Flink cluster

Required services

Service name Master node Core node
HDFS
  • KMS
  • SecondaryNameNode
  • HttpFS
  • HDFS Client
  • NameNode
  • DataNode
  • HDFS Client
YARN
  • ResourceManager
  • App Timeline Server
  • JobHistory
  • WebAppProxyServer
  • Yarn Client
  • Yarn Client
  • NodeManager
Ganglia
  • Gmond
  • Httpd
  • Gmetad
  • Ganglia Client
  • Gmond
  • Ganglia Client
ZooKeeper
  • ZooKeeper follower
  • ZooKeeper Client
  • ZooKeeper leader
  • ZooKeeper follower
  • ZooKeeper Client
Zeppelin Zeppelin N/A
Flink
  • FlinkHistoryServer
  • Flink Client
 Flink Client
HAS HASServer N/A
SmartData
  • JindoFS Namespace Service
  • JindoFS Storage Service
  • SmartData Client
  • JindoFS Storage Service
  • SmartData Client
Bigboot
  • Bigboot Client
  • Bigboot Monitor
  • Bigboot Client
  • Bigboot Monitor
OpenLDAP OpenLDAP N/A
Grafana GrafanaServer N/A
Prometheus PrometheusServer N/A
Alertmanager AlertManager N/A