All Products
Search

This Product

    E-MapReduce:Manage automatic supplementation

    Document Center

    E-MapReduce:Manage automatic supplementation

    Last Updated:Mar 15, 2024

    The automatic supplementation feature of E-MapReduce (EMR) can replace the Elastic Compute Service (ECS) instances in your EMR cluster with new instances when EMR identifies that the ECS instances cannot run the engine services as expected.

    Prerequisite

    A DataLake cluster, a Dataflow cluster, or a custom cluster is created, and the YARN service is deployed in the cluster. For more information, see Create a cluster.

    Limits

    Only pay-as-you-go task node groups support the automatic supplementation feature.

    Precautions

    • Automatic supplementation may fail in the following scenarios:

      • A system issue occurs on the ECS instances to be replaced.

      • Release protection is enabled for the ECS instances to be replaced.

      • The number of nodes in the node group to which the ECS instances to be replaced belong is less than or equal to the minimum number of nodes that must be reserved for the node group.

    • The bootstrap action script is automatically run on new ECS instances during the scale-out process. If the ECS instances to be replaced contain manually deployed components or services, you must redeploy the components or services on the new instances after the replacement.

    Enable or disable automatic supplementation

    1. Go to the Nodes tab.

      1. Log on to the EMR console. In the left-side navigation pane, click EMR on ECS.

      2. In the top navigation bar, select the region in which your cluster resides and select a resource group based on your business requirements.

      3. On the EMR on ECS page, find the cluster that you want to scale out and click Nodes in the Actions column.

    2. On the Nodes tab, click the name of the node group that you want to manage in the Node Group Name / ID column.

    3. In the Node Group Attributes panel, turn on or turn off Automatic Compensation.

      Note

      From 18:00 (UTC+8) on July 10, 2023, Automatic Compensation is turned on for new pay-as-you-go task node groups by default.

    4. In the message that appears, click OK.

    5. Click Save.

    View the automatic supplementation status

    On the Nodes tab, you can view the automatic supplementation status in the Automatic Supplementation column.

    If you enable the automatic supplementation feature and automatic supplementation is performed on a node group within a week, the number of times automatic supplementation is performed is displayed in the Automatic Supplementation column. You can move the pointer over the number and click View event details to view the details.