E-MapReduce (EMR) allows you to modify, add, and view configuration items for services such as Hadoop Distributed File System (HDFS), YARN, and Spark in the EMR console. This topic describes how to modify, add, and view configuration items in the EMR console.
Prerequisites
An EMR cluster is created. For more information, see Create a cluster.
Modify configuration items
Go to the Configure tab of a service.
Log on to the EMR console. In the left-side navigation pane, click EMR on ECS.
In the top navigation bar, select the region in which your cluster resides and select a resource group based on your business requirements.
On the EMR on ECS page, find the desired cluster and click Services in the Actions column.
On the Services tab, find the desired service and click Configure.
Modify configuration items.
In the search box, enter the name of the configuration item that you want to modify and click the search icon.
Change the value of the configuration item.
Save the configurations.
On the Configure tab, click Save.
In the Save dialog box, configure the Execution Reason parameter and click Save.
NoteIn the Save dialog box, the Save and Deliver Configuration switch is turned on by default. After you save the configurations, the configurations are also sent to the client. You can make the configurations take effect in manual mode. If you turn off Save and Deliver Configuration in the Save dialog box, you can make the configurations take effect in prompt mode.
Make the configurations take effect.
To allow the modifications to take effect, perform the following operations based on the type of the configuration item you modified:
Manual mode
Client-side configurations
Click Deploy Client Configuration next to Save in the lower part of the page.
In the dialog box that appears, configure the Execution Reason parameter and click OK.
In the Confirm message, click OK.
Server-side configurations
Choose
in the upper-right corner of the Configure tab.In the dialog box that appears, configure the Execution Reason parameter and click OK.
In the Confirm message, click OK.
Prompt mode
NoteThis mode is available only for EMR V5.12.1, EMR V3.46.1, or a minor version later than EMR V5.12.1 or EMR V3.46.1.
Client-side configurations
After you save the configurations, the prompt appears.
Click the To Be Delivered prompt.
In the Configurations to Be Delivered message, click Deliver.
NoteFor the YARN service, if the configuration items that you modified contain queue-related configuration items, you need to click the prompt or click Deploy on the Edit Resource Queue tab of the YARN service page to make the modifications take effect after you save and deliver the modifications.
Server-side configurations
After you save the configurations, the prompt appears.
Click the Not Effective Yet prompt.
In the Configurations to Take Effect dialog box, configure settings based on the mode in which you can make the configurations take effect.
Configurations That Require Custom Operations
Manually click items in the Actions column that corresponds to a component to make the configurations take effect.
Configurations That Require Restart
Click restart in the Actions column that corresponds to a component. Alternatively, select multiple components and click Batch Restart.
In the dialog box that appears, configure the Execution Reason parameter and click OK.
Add configuration items
Go to the Configure tab of a service.
Log on to the EMR console. In the left-side navigation pane, click EMR on ECS.
In the top navigation bar, select the region in which your cluster resides and select a resource group based on your business requirements.
On the EMR on ECS page, find the desired cluster and click Services in the Actions column.
On the Services tab, find the desired service and click Configure.
Add configuration items.
Click the tab on which you want to add configuration items.
Click Add Configuration Item.
Add configuration items based on your business requirements.
You can add multiple configuration items at the same time.
Configuration item
Description
Key
The name of the configuration item.
Value
The value of the configuration item.
Description
The description of the configuration item.
Actions
You can remove configuration items.
Click OK.
In the dialog box that appears, configure the Execution Reason parameter and click Save.
Make the configurations take effect.
To allow the modifications to take effect, perform the following operations based on the type of the configuration item you modified:
Manual mode
Client-side configurations
Click Deploy Client Configuration next to Save in the lower part of the page.
In the dialog box that appears, configure the Execution Reason parameter and click OK.
In the Confirm message, click OK.
Server-side configurations
Choose
in the upper-right corner of the Configure tab.In the dialog box that appears, configure the Execution Reason parameter and click OK.
In the Confirm message, click OK.
Prompt mode
NoteThis mode is available only for EMR V5.12.1, EMR V3.46.1, or a minor version later than EMR V5.12.1 or EMR V3.46.1.
Client-side configurations
After you save the configurations, the prompt appears.
Click the To Be Delivered prompt.
In the Configurations to Be Delivered message, click Deliver.
NoteFor the YARN service, if the configuration items that you modified contain queue-related configuration items, you need to click the prompt or click Deploy on the Edit Resource Queue tab of the YARN service page to make the modifications take effect after you save and deliver the modifications.
Server-side configurations
After you save the configurations, the prompt appears.
Click the Not Effective Yet prompt.
In the Configurations to Take Effect dialog box, configure settings based on the mode in which you can make the configurations take effect.
Configurations That Require Custom Operations
Manually click items in the Actions column that corresponds to a component to make the configurations take effect.
Configurations That Require Restart
Click restart in the Actions column that corresponds to a component. Alternatively, select multiple components and click Batch Restart.
In the dialog box that appears, configure the Execution Reason parameter and click OK.
View configuration items
By default, the Configure tab for a service displays default cluster-level configuration items. You can also select Node Group Configuration or Independent Node Configuration from the Default Cluster Configuration drop-down list.
If a configuration item at the node group or node level is modified, or the settings of a configuration item are inconsistent with the default settings at the cluster level, the settings of the configuration item at the node group or node level are displayed on the Configure tab, with Default Cluster Configuration selected.
On the Configure tab with Default Cluster Configuration selected, the configuration items at the node group or node level can only be viewed. To modify a configuration item at the node group or node level, perform the following operations: Select the desired file subtab on the Configure tab, select Node Group Configuration or Independent Node Configuration, modify the configuration item, and then save the configurations.