All Products
Search

This Product

    E-MapReduce:Manage YARN partitions in the console

    Document Center

    E-MapReduce:Manage YARN partitions in the console

    Last Updated:Aug 20, 2026

    EMR provides a visual UI in the console to manage YARN partitions. You can map node groups to partitions in batches. You can configure partition properties directly on a node group. After a scale-out or an auto scaling event, EMR automatically applies a node label to new nodes, which eliminates manual reconfiguration. This topic describes how to manage YARN partitions in the EMR console.

    Background

    This feature is suitable for the following scenarios:

    • Heterogeneous clusters

      Clusters are often heterogeneous, consisting of different machine types. For example, a cluster may contain a mix of compute-optimized, memory-optimized, and storage-optimized machines.

    • Multiple computing frameworks sharing cluster resources

      A resource-intensive batch job, such as a Flink application, can consume excessive network or CPU resources, potentially starving near-real-time workloads on the same cluster.

    • Guaranteed resources for critical jobs

      To prevent critical jobs from running on elastic nodes, you can configure a dedicated partition using only inelastic nodes and assign the jobs to it. This ensures that critical jobs are not delayed by scale-in events.

    YARN partition management allows operators to divide nodes into partitions based on their characteristics, such as roles and processing capabilities. This ensures jobs run on specific nodes, enabling better resource scheduling for clusters with mixed machine types or diverse applications.

    Prerequisites

    The cluster is in the Running state. For more information about how to create a cluster, see Create a cluster.

    Limitations

    • This feature is available for EMR V5.11.1 and later, and EMR V3.45.1 and later.

    • The cluster must be in the Running state.

    • The YARN scheduler must use the capacity scheduler.

    Notes

    • After you add or edit a partition, click Deploy. Perform this operation during off-peak hours.

    • If the YARN scheduler is switched to fair scheduler, you must turn off the Node Labels switch.

    Add a partition

    1. Go to the configuration page of the YARN service.

      1. Log on to the E-MapReduce console.

      2. In the top navigation bar, select a region and resource group.

      3. On the EMR on ECS page, find your target cluster and click Services in the Actions column.

      4. On the Services page, click Configure in the YARN section.

    2. Click the Partitions tab.

    3. Click Add Partition. In the Add Partition dialog box, configure the parameters.

      Parameter

      Description

      Partition Name

      The partition name.

      The name must be 1 to 255 characters in length and can contain only letters, digits, hyphens (-), and underscores (_).

      Note

      • You can create a partition named DEFAULT.

      • The partition name cannot start with a hyphen (-) or an underscore (_).

      Partition Type

      • Exclusive (Default): Allows only containers that explicitly request this partition to be scheduled on its nodes.

      • Non Exclusive: Shares idle resources with containers that request the DEFAULT partition.

      Associated Node Groups

      Select the node groups to associate with the partition. Each node group can be associated with only one partition, but you can modify this association later.

    4. Click OK.

    5. Click Deploy.

      After the system applies the configuration update, the new partition appears in the YARN UI.

      By default, the changes take effect after 10 minutes. If you want the changes to take effect sooner, you can add the yarn.nodemanager.node-labels.resync-interval-ms and yarn.nodemanager.node-labels.provider.fetch-interval-ms configuration items to the yarn-site.xml file on the Configure tab to change the effective time. Then, go to the Status tab and manually restart the NodeManager component.

    Edit a partition

    1. On the Partitions tab of the YARN service in the EMR console, find the partition that you want to modify and click Edit in the Actions column.

    2. In the Edit Partition dialog box, you can only modify the associated node groups.

    3. Click OK.

    4. Click Deploy to apply the changes.

    Delete a partition

    1. On the Partitions tab of the YARN service in the EMR console, find the partition that you want to delete and click Delete in the Actions column.

    2. In the confirmation dialog box that appears, click OK.

    3. Click Deploy to apply the change.

      Note

      • Deleting a partition disassociates the node groups linked to it.

      • If the partition is bound to a queue, you must go to the Edit Resource Queue tab and turn off the Partition-queue Association Management switch before deleting the partition.

    View the partition list

    On the Partitions tab of the YARN service, you can view information such as partition names, accessible queues, node groups, partition types, and total resources.

    Disable partition management

    To switch from the capacity scheduler to the fair scheduler, turn off the Node Labels switch on the Partitions tab of the YARN service. Then, click the image.png notification icon above the Edit Resource Queue tab. In the Configurations to Take Effect panel, select all configuration items and click batch to apply the changes and disable partition management.

    Remove the Partitions tab

    To manage partitions with custom scripts and prevent validation by the EMR console, go to the YARN service's Configure tab and change the node_labels_managed_by_emr parameter in yarn-operator-conf to false. After you refresh the page, the Partitions tab is hidden, and the system no longer validates the node-labels.xml file. For more information about how to configure Node Labels, see Use the Node Labels feature.