This topic describes how to add, modify, and remove node groups.
Background information
You can add node groups to meet your requirements for different types of instances. For example, you can use memory optimized instances with 1 vCPU and 8 GiB of memory to support offline big data processing and use compute optimized instances with 1 vCPU and 2 GiB of memory to support model training.
Prerequisites
A Hadoop cluster, Data Science cluster, or E-MapReduce (EMR) Studio cluster is created in the EMR console. For more information, see Create a cluster.
Prerequisites
You can add core node groups and task node groups.
You can add up to 10 node groups.
You can remove only task node groups. You cannot remove core node groups.
Precautions
If the number of nodes in the node group that you want to remove is greater than 0, you must release the Elastic Compute Service (ECS) instances in the node group before you remove the node group.
Add a node group
Go to the Nodes tab.
In the top navigation bar, select the region where your cluster resides and select a resource group based on your business requirements.
On the EMR on ECS page, find the cluster that you want to scale out and click Nodes in the Actions column.
On the Nodes tab, click Add Node Group.
In the Add Node Group panel, configure the parameters that are described in the following table.
Parameter
Description
Node Group Type
Valid values: CORE (Core Node Group) and TASK (Task Node Group).
Billing Method
The billing method of the node group.
Node Group Name
The name of the node group. The name of the node group must be unique.
vSwitch
Select a vSwitch in the current virtual private cloud (VPC). You cannot change the vSwitch after the node group is added.
Instance Type
The instance type for the node group. You can select an instance type based on your business requirements.
Storage Configuration
System Disk: Select an enhanced SSD or an ultra disk based on your business requirements. Valid values: 60 to 500. Unit: GiB. We recommend that you set the size to at least 120 GiB.
Data Disk: Select enhanced SSDs or ultra disks based on your business requirements. Valid values: 40 to 32768. Unit: GiB. We recommend that you set the size to at least 80 GiB.
Click OK.
You can view the node group that you added on the Nodes tab.
Modify a node group
Go to the Nodes tab.
In the top navigation bar, select the region where your cluster resides and select a resource group based on your business requirements.
On the EMR on ECS page, find the cluster that you want to scale out and click Nodes in the Actions column.
On the Nodes tab, find the node group that you want to modify and click the name of the node group in the Node Group Name / ID column.
In the Node Group Attributes panel, you can modify the name of the node group and click Save.
Remove a node group
Go to the Nodes tab.
In the top navigation bar, select the region where your cluster resides and select a resource group based on your business requirements.
On the EMR on ECS page, find the cluster that you want to scale out and click Nodes in the Actions column.
On the Nodes tab, find the node group that you want to remove, move the pointer over the More icon in the Actions column, and then select Delete Node Group.
NoteYou must release the ECS instances in the node group before you remove the node group.
In the Confirm message, click Delete.
References
For information about how to scale out a node group, see Scale out an EMR cluster.
For information about how to scale in a node group, see Scale in a cluster.
For information about how to resize a disk, see Expand a disk.
For information about how to configure auto scaling rules, see Configure auto scaling (only for Hadoop clusters).
For information about how to view auto scaling records, see View auto scaling records (Hadoop clusters).