All Products
Search
Document Center

E-MapReduce:Queue management

Last Updated:Feb 28, 2025

Each workspace includes two default queues, dev_queue and root_queue, for running tasks. To achieve resource isolation and management, additional queues can be added. This topic describes the basic operations for managing queues.

Prerequisites

A workspace has been created. For more information, see Managing Workspaces.

Add queues

Note

Resource isolation and management can be achieved by adding queues. Without adding new resource queues, the default dev_queue and root_queue can be used to run tasks. A subscription_queue is automatically generated if a subscription quota is purchased.

  1. Go to the Resource Management page.

    1. Log on to the E-MapReduce Console.

    2. In the left-side navigation pane, select EMR Serverless > Spark.

    3. On the Spark page, click the target workspace name.

    4. On the EMR Serverless Spark page, click Resource Management in the left-side navigation pane.

  2. On the Queue Resources tab, click Add Queue.

  3. In the Add Queue dialog box, set the following parameters, and then click OK.

    Parameter

    Description

    Queue Name

    The queue name must be unique.

    Note

    After the queue is successfully added, you cannot modify the Queue Name.

    Billing Type

    Supports Pay-as-you-go and Subscription types.

    If you select the Subscription type, you need to purchase the corresponding subscription quota first. For specific operations, see Subscription.

    Concurrency Limit

    This parameter is only applicable to Pay-as-you-go queues.

    The maximum number of compute units (CUs) that can run concurrently in the queue. Based on the configuration information of the session instance, set the concurrency limit of the selected deployment queue to at least 3 CUs.

    For details on adjusting the concurrency limit of other queues, see Modify concurrency limit.

    Resource Amount (CU)

    This parameter is only applicable to Subscription queues.

    The maximum configurable resource amount is determined by the remaining subscription quota of the current workspace. If the remaining subscription quota of the workspace is insufficient, you can adjust it in the following ways:

    • Adjust the resource amount of other queues. For details, see Modify resource amount.

    • Repurchase the subscription quota. For details, see Subscription.

    Application Environment

    • Development: A place where developers write, test, and debug code. It usually includes an integrated development environment (IDE), version control systems, and various debugging tools for developers to build and debug software.

    • Production: The actual running environment for users, providing stable, efficient, and secure services.

Modify concurrency limit

Note

This operation is only applicable to Pay-as-you-go queues.

  1. On the Resource Management page, on the Queue Resources tab, click Edit Queue in the operation column of the target queue.

  2. On the Edit Queue page, on the Resource tab, adjust the Concurrency Limit.

  3. After adjustment, click OK.

Modify resource amount

Note

This operation is only applicable to Subscription queues.

  1. On the Resource Management page, on the Queue Resources tab, click Edit Queue in the operation column of the target queue.

  2. On the Edit Queue page, on the Resource tab, adjust the Resource Amount (CU).

  3. After adjustment, click OK.

Edit queue permissions

  1. On the Resource Management page, on the Queue Resources tab, click Edit Queue in the operation column of the target queue.

  2. In the Edit Permissions dialog box, click the Permissions tab.

  3. Add, modify, or remove users and their permissions as needed.

  4. Click OK.

Delete queues

Important
  • Deleting the root_queue is not supported.

  • Ensure no tasks are associated with the queue before deletion, as it will affect all associated tasks in the workspace.

  1. On the Resource Management page, on the Queue Resources tab, click Delete in the operation column of the target queue.

  2. In the Delete Queue dialog box, click Delete Queue.

References