Each workspace includes two default queues, dev_queue and root_queue, for running tasks. To achieve resource isolation and management, additional queues can be added. This topic describes the basic operations for managing queues.
Prerequisites
A workspace has been created. For more information, see Managing Workspaces.
Add queues
Resource isolation and management can be achieved by adding queues. Without adding new resource queues, the default dev_queue and root_queue can be used to run tasks. A subscription_queue is automatically generated if a subscription quota is purchased.
-
Go to the Resource Management page.
-
Log on to the E-MapReduce Console.
-
In the left-side navigation pane, select .
-
On the Spark page, click the target workspace name.
-
On the EMR Serverless Spark page, click Resource Management in the left-side navigation pane.
-
-
On the Queue Resources tab, click Add Queue.
-
In the Add Queue dialog box, set the following parameters, and then click OK.
Parameter
Description
Queue Name
The queue name must be unique.
NoteAfter the queue is successfully added, you cannot modify the Queue Name.
Billing Type
Supports Pay-as-you-go and Subscription types.
If you select the Subscription type, you need to purchase the corresponding subscription quota first. For specific operations, see Subscription.
Concurrency Limit
This parameter is only applicable to Pay-as-you-go queues.
The maximum number of compute units (CUs) that can run concurrently in the queue. Based on the configuration information of the session instance, set the concurrency limit of the selected deployment queue to at least 3 CUs.
For details on adjusting the concurrency limit of other queues, see Modify concurrency limit.
Resource Amount (CU)
This parameter is only applicable to Subscription queues.
The maximum configurable resource amount is determined by the remaining subscription quota of the current workspace. If the remaining subscription quota of the workspace is insufficient, you can adjust it in the following ways:
Adjust the resource amount of other queues. For details, see Modify resource amount.
Repurchase the subscription quota. For details, see Subscription.
Application Environment
Development: A place where developers write, test, and debug code. It usually includes an integrated development environment (IDE), version control systems, and various debugging tools for developers to build and debug software.
Production: The actual running environment for users, providing stable, efficient, and secure services.
Modify concurrency limit
This operation is only applicable to Pay-as-you-go queues.
-
On the Resource Management page, on the Queue Resources tab, click Edit Queue in the operation column of the target queue.
-
On the Edit Queue page, on the Resource tab, adjust the Concurrency Limit.
-
After adjustment, click OK.
Modify resource amount
This operation is only applicable to Subscription queues.
-
On the Resource Management page, on the Queue Resources tab, click Edit Queue in the operation column of the target queue.
-
On the Edit Queue page, on the Resource tab, adjust the Resource Amount (CU).
-
After adjustment, click OK.
Edit queue permissions
-
On the Resource Management page, on the Queue Resources tab, click Edit Queue in the operation column of the target queue.
-
In the Edit Permissions dialog box, click the Permissions tab.
-
Add, modify, or remove users and their permissions as needed.
-
Click OK.
Delete queues
-
Deleting the root_queue is not supported.
-
Ensure no tasks are associated with the queue before deletion, as it will affect all associated tasks in the workspace.
-
On the Resource Management page, on the Queue Resources tab, click Delete in the operation column of the target queue.
-
In the Delete Queue dialog box, click Delete Queue.
References
-
For instructions on creating and running workflows, refer to Manage Workflows.
-
For information on permission-related operations, see Manage Users and Roles.
-
For information on managing SQL sessions, see Manage SQL sessions.