This topic describes the methods that you can use to access the web UIs of open source components deployed in an E-MapReduce (EMR) cluster. You can configure security group rules and access links to access the web UIs of open source components that are deployed in an EMR cluster.
Prerequisites
An EMR cluster is created. For more information, see Create a cluster.
Background information
Method | Benefit | Limit |
---|---|---|
Access the web UIs of open source components by using Knox (recommended) |
|
|
Access the web UIs of open source components by using the public IP address or the internal IP address of the master node | You can access the web UIs of open source components without the need to add other services. | You must add security group rules based on the service ports that you want to access and enable a large number of ports. |
Access the web UIs of open source components by using Knox (recommended)
Add a security group rule
The first time you use a component, you must perform the following steps to configure security group rules:
- Obtain the public IP address of your on-premises machine.
For security purposes, we recommend that you allow access only from the current public IP address when you configure a security group rule. To obtain your current public IP address, visit IP address.
- Go to the cluster information page.
- Log on to the EMR console. In the left-side navigation pane, click EMR on ECS.
- In the top navigation bar, select the region where your cluster resides and select a resource group based on your business requirements.
- On the EMR on ECS page, click the ID in the Cluster ID column of the cluster that you want to view.
- Add security group rules.
Access the web UIs of open source components
- Go to the Access Links and Ports tab.
- Log on to the EMR console. In the left-side navigation pane, click EMR on ECS.
- In the top navigation bar, select the region where your cluster resides and select a resource group based on your business requirements.
- On the EMR on ECS page, find the desired cluster and click the name of the cluster.
- On the page that appears, click the Access Links and Ports tab.
- On the Access Links and Ports tab, find the component whose web UI you want to access and click the link of the web UI in the Access URL column.
Important If you do not assign a public IP address to the master node of the cluster, you can access the web UIs of open source components only by using Knox. If you want to use a public IP address to access the web UIs of open source components, perform the following operations in this step.
- On the Nodes tab, click the desired node group and click the ID of the header-1 node in the Node Name/ID column.
- In the Elastic Compute Service (ECS) console, associate an elastic IP address (EIP) with the ECS instance of the header-1 node. For more information, see Associate or disassociate an EIP.
- Synchronize host information.
- On the Nodes tab, choose in the upper-right corner.
- In the message that appears, click Off.
On the Access Links and Ports tab, you can access the web UIs of open source components by using Knox.
- Use the added user for logon authentication and access the web UI of the corresponding open source component.
Methods that can be used to access the web UIs of some special open source components:
- Access the web UI of Ranger
After Ranger is deployed in a cluster, you can use the default username and password of Ranger to access the web UI of Ranger. For more information, see Overview.Note For Hadoop clusters, the default username and password of Ranger are admin. For DataLake clusters or custom clusters, the default username of Ranger is admin and the default password is admin1234.
- Access the web UI of Flink (later minor versions earlier than EMR V3.29.0)
In later minor versions earlier than EMR V3.29.0, you can access the web UI of Flink only by using an SSH tunnel. For more information, see Create an SSH tunnel to access web UIs of open source components.Note To access a Flink job on the web UI of YARN, go to the Access Links and Ports tab in the EMR console, and click the link of the YARN UI in the Access URL column. In the Hadoop console, click the ID of the Flink job to view the details of the Flink job.
- Access the web UI of Ranger
Access the web UIs of open source components by using the public IP address or the internal IP address of the master node
Add a security group rule
- Obtain the public IP address of your on-premises machine.
For security purposes, we recommend that you allow access only from the current public IP address when you configure a security group rule. To obtain your current public IP address, visit IP address.
- Go to the cluster information page.
- Log on to the EMR console. In the left-side navigation pane, click EMR on ECS.
- In the top navigation bar, select the region where your cluster resides and select a resource group based on your business requirements.
- On the EMR on ECS page, click the ID in the Cluster ID column of the cluster that you want to view.
- Add security group rules.
Access the web UIs of open source components
- Go to the Access Links and Ports tab.
- Log on to the EMR console. In the left-side navigation pane, click EMR on ECS.
- In the top navigation bar, select the region where your cluster resides and select a resource group based on your business requirements.
- On the EMR on ECS page, find the desired cluster and click the name of the cluster.
- On the page that appears, click the Access Links and Ports tab.
- On the Access Links and Ports tab, find the component whose web UI you want to access and click the link of the web UI in the Access URL column.