All Products
Search
Document Center

E-MapReduce:Manage configuration items

Last Updated:Sep 20, 2023

E-MapReduce (EMR) allows you to modify, add, and view configuration items for services such as Hadoop Distributed File System (HDFS), YARN, and Spark in the EMR console. This topic describes how to modify, add, and view configuration items in the EMR console.

Prerequisites

An EMR cluster is created. For more information, see Create a cluster.

Modify configuration items

  1. Go to the Configure tab of a service.

    1. Log on to the EMR console. In the left-side navigation pane, click EMR on ECS.

    2. In the top navigation bar, select the region in which your cluster resides and select a resource group based on your business requirements.

    3. On the EMR on ECS page, find the desired cluster and click Services in the Actions column.

    4. On the Services tab, find the desired service and click Configure.

  2. Modify configuration items.

    1. In the search box, enter the name of the configuration item that you want to modify and click the search icon.

    2. Change the value of the configuration item.

  3. Save the configurations.

    1. On the Configure tab, click Save.

    2. In the Save dialog box, configure the Execution Reason parameter and click Save.

      Note

      In the Save dialog box, the Save and Deliver Configuration switch is turned on by default. After you save the configurations, the configurations are also sent to the client. You can make the configurations take effect in manual mode. If you turn off Save and Deliver Configuration in the Save dialog box, you can make the configurations take effect in prompt mode.

  4. Make the configurations take effect.

    To allow the modifications to take effect, perform the following operations based on the type of the configuration item you modified:

    Manual mode

    • Client-side configurations

      1. Click Deploy Client Configuration next to Save in the lower part of the page.

      2. In the dialog box that appears, configure the Execution Reason parameter and click OK.

      3. In the Confirm message, click OK.

    • Server-side configurations

      1. Choose More > Restart in the upper-right corner of the Configure tab.

      2. In the dialog box that appears, configure the Execution Reason parameter and click OK.

      3. In the Confirm message, click OK.

    Prompt mode

    Note

    This mode is available only for EMR V5.12.1, EMR V3.46.1, or a minor version later than EMR V5.12.1 or EMR V3.46.1.

    • Client-side configurations

      1. After you save the configurations, the image.png prompt appears.

      2. Click the To Be Delivered prompt.

      3. In the Configurations to Be Delivered message, click Deliver.

        Note

        For the YARN service, if the configuration items that you modified contain queue-related configuration items, you need to click the image.png prompt or click Deploy on the Edit Resource Queue tab of the YARN service page to make the modifications take effect after you save and deliver the modifications.

    • Server-side configurations

      1. After you save the configurations, the image.png prompt appears.

      2. Click the Not Effective Yet prompt.

      3. In the Configurations to Take Effect dialog box, configure settings based on the mode in which you can make the configurations take effect.

        • Configurations That Require Custom Operations

          Manually click items in the Actions column that corresponds to a component to make the configurations take effect.

        • Configurations That Require Restart

          1. Click restart in the Actions column that corresponds to a component. Alternatively, select multiple components and click Batch Restart.

          2. In the dialog box that appears, configure the Execution Reason parameter and click OK.

Add configuration items

  1. Go to the Configure tab of a service.

    1. Log on to the EMR console. In the left-side navigation pane, click EMR on ECS.

    2. In the top navigation bar, select the region in which your cluster resides and select a resource group based on your business requirements.

    3. On the EMR on ECS page, find the desired cluster and click Services in the Actions column.

    4. On the Services tab, find the desired service and click Configure.

  2. Add configuration items.

    1. Click the tab on which you want to add configuration items.

    2. Click Add Configuration Item.

    3. Add configuration items based on your business requirements.

      You can add multiple configuration items at the same time.

      Configuration item

      Description

      Key

      The name of the configuration item.

      Value

      The value of the configuration item.

      Description

      The description of the configuration item.

      Actions

      You can remove configuration items.

    4. Click OK.

    5. In the dialog box that appears, configure the Execution Reason parameter and click Save.

  3. Make the configurations take effect.

    To allow the modifications to take effect, perform the following operations based on the type of the configuration item you modified:

    Manual mode

    • Client-side configurations

      1. Click Deploy Client Configuration next to Save in the lower part of the page.

      2. In the dialog box that appears, configure the Execution Reason parameter and click OK.

      3. In the Confirm message, click OK.

    • Server-side configurations

      1. Choose More > Restart in the upper-right corner of the Configure tab.

      2. In the dialog box that appears, configure the Execution Reason parameter and click OK.

      3. In the Confirm message, click OK.

    Prompt mode

    Note

    This mode is available only for EMR V5.12.1, EMR V3.46.1, or a minor version later than EMR V5.12.1 or EMR V3.46.1.

    • Client-side configurations

      1. After you save the configurations, the image.png prompt appears.

      2. Click the To Be Delivered prompt.

      3. In the Configurations to Be Delivered message, click Deliver.

        Note

        For the YARN service, if the configuration items that you modified contain queue-related configuration items, you need to click the image.png prompt or click Deploy on the Edit Resource Queue tab of the YARN service page to make the modifications take effect after you save and deliver the modifications.

    • Server-side configurations

      1. After you save the configurations, the image.png prompt appears.

      2. Click the Not Effective Yet prompt.

      3. In the Configurations to Take Effect dialog box, configure settings based on the mode in which you can make the configurations take effect.

        • Configurations That Require Custom Operations

          Manually click items in the Actions column that corresponds to a component to make the configurations take effect.

        • Configurations That Require Restart

          1. Click restart in the Actions column that corresponds to a component. Alternatively, select multiple components and click Batch Restart.

          2. In the dialog box that appears, configure the Execution Reason parameter and click OK.

View configuration items

By default, the Configure tab for a service displays default cluster-level configuration items. You can also select Node Group Configuration or Independent Node Configuration from the Default Cluster Configuration drop-down list.

image.png
Note

If a configuration item at the node group or node level is modified, or the settings of a configuration item are inconsistent with the default settings at the cluster level, the settings of the configuration item at the node group or node level are displayed on the Configure tab, with Default Cluster Configuration selected.

On the Configure tab with Default Cluster Configuration selected, the configuration items at the node group or node level can only be viewed. To modify a configuration item at the node group or node level, perform the following operations: Select the desired file subtab on the Configure tab, select Node Group Configuration or Independent Node Configuration, modify the configuration item, and then save the configurations.