When automatic compensation is enabled for a node group, E-MapReduce (EMR) automatically handles faulty ECS instances that can no longer run engine services. For pay-as-you-go task nodes, EMR creates a new ECS instance to replace the faulty one. For subscription task nodes, EMR redeploys the faulty instance.
Prerequisites
You have created a DataLake, DataFlow, or Custom cluster with the YARN service deployed. For more information, see Create a cluster.
Limitations
Only task node groups support this feature.
Usage notes
-
Automatic compensation may fail in the following situations:
-
The ECS instance to be replaced has a system issue.
-
Release protection is enabled for the ECS instance to be replaced.
-
The number of nodes in the node group is less than or equal to the configured minimum.
-
-
Bootstrap action scripts run automatically on the new ECS instance during scale-out. However, you must manually redeploy any components or services that were manually deployed on the original instance.
Enable or disable automatic compensation
-
Go to the node management page.
-
Log on to the EMR console.
-
In the top navigation bar, select a region and a resource group as needed.
-
In the Actions column of the target cluster, click Nodes.
-
-
On the Nodes page, click the name of a node group.
-
In the Node Group Attributes panel, turn the Automatic Compensation switch on or off.
NoteStarting from 18:00 (UTC+8) on July 10, 2023, the Automatic Compensation switch is enabled by default when you create a pay-as-you-go task node group.
-
In the dialog box that appears, click OK.
-
Click Save.
View automatic compensation status
The Nodes page displays the automatic compensation status.
If automatic compensation was triggered for a node group in the last week, the Automatic Supplementation column shows the number of occurrences. Hover over the count and click View event details in the tooltip.