Each workspace includes two default queues for running jobs: dev_queue and root_queue. You can add queues to isolate and manage resources. This topic describes basic queue operations.
Prerequisites
A workspace has been created. For more information, see Manage workspaces.
Add a queue
You can add queues to isolate and manage resources. If you do not add a new resource queue, jobs run in the default dev_queue and root_queue. If you purchase a subscription quota, the system creates a subscription_queue queue by default.
Go to the Resource Management page.
Log on to the E-MapReduce console.
In the navigation pane on the left, choose .
On the Spark page, click the name of the target workspace.
On the EMR Serverless Spark page, click Resource Management in the left navigation pane.
On the Queue Resources tab, click Add Queue.
In the Add Queue dialog box, set the following parameters based on the workspace's billing method, and click OK.
Pay-as-you-go
Parameter
Description
Queue Name
The queue name must be unique.
NoteYou cannot change the Queue Name after the queue is added.
Elastic Concurrency Limit (CU)
The maximum number of concurrent compute units (CUs) that can run in the queue. Based on the configuration of the session instance, set the concurrency limit of the selected deployment queue to at least 3 CUs.
For more information about how to adjust the concurrency limit for other queues, see Adjust queue resources.
Application Environment
Development: An environment where developers write, test, and debug code. It usually includes an integrated development environment (IDE), a versioning system, and various debugging tools for developers to build and debug software.
Production: The actual running environment for users. It provides stable, efficient, and secure services.
Subscription
Parameter
Description
Queue Name
The queue name must be unique.
NoteYou cannot change the Queue Name after the queue is added.
Fixed Resources (CU)
The maximum amount of resources is determined by the remaining subscription quota of the current workspace. If the remaining subscription quota is insufficient, you can adjust it in one of the following ways:
Adjust the resource amount of other queues. For more information, see Adjust queue resources.
Purchase a new subscription quota. For more information, see Subscription.
Application Environment
Development: An environment where developers write, test, and debug code. It usually includes an integrated development environment (IDE), a versioning system, and various debugging tools for developers to build and debug software.
Production: The actual running environment for users. It provides stable, efficient, and secure services.
Hybrid billing
NoteHybrid billing is a feature that is available only to whitelisted users. To use this feature, you must submit a ticket.
Parameter
Description
Queue Name
The queue name must be unique.
NoteYou cannot change the Queue Name after the queue is added.
Elastic Concurrency Limit (CU)
The maximum number of concurrent compute units (CUs) that can run in the queue. Based on the configuration of the session instance, set the concurrency limit of the selected deployment queue to at least 3 CUs.
For more information about how to adjust the concurrency limit for other queues, see Adjust queue resources.
Fixed Resources (CU)
The maximum amount of resources is determined by the remaining subscription quota of the current workspace. If the remaining subscription quota is insufficient, you can adjust it in the following way:
Adjust the resource amount of other queues. For more information, see Adjust queue resources.
Application Environment
Development: An environment where developers write, test, and debug code. It usually includes an integrated development environment (IDE), a versioning system, and various debugging tools for developers to build and debug software.
Production: The actual running environment for users. It provides stable, efficient, and secure services.
Edit a queue
Adjust queue resources
Perform the following operations based on the billing method of the workspace.
Pay-as-you-go
On the Queue Resources tab of the Resource Management page, find the target queue and in the Actions column, click Edit Queue.
On the Resources tab in the Edit Queue dialog box, adjust the Elastic Concurrency Limit (CU).
After you make the adjustment, click OK.
Subscription
On the Queue Resources tab on the Resource Management page, find the target queue and click Edit Queue in the Actions column.
On the Resources tab in the Edit Queue dialog box, you can adjust the Fixed Resources (CU).
After making the adjustment, click OK.
Hybrid billing
Hybrid billing is a feature that is available only to whitelisted users. To use this feature, you must submit a ticket.
On the Resource Management page, go to the Queue Resources tab, find the target queue, and click Edit Queue in the Actions column.
On the Resources tab in the Edit Queue dialog box, you can adjust the Fixed Resources (CU) and Elastic Concurrency Limit (CU).
After making the adjustment, click OK.
Edit queue permissions
On the Queue Resources tab of the Resource Management page, find the target queue and click Edit Queue.
In the Edit Permissions dialog box, click the Permissions tab.
You can add, modify, or remove users and their permissions.
Click OK.
Delete a queue
You cannot delete the root_queue.
Before you delete a resource queue, make sure that no jobs in the workspace are associated with the queue. Otherwise, all associated jobs will be affected.
On the Resource Management page, on the Queue Resources tab, find the target queue and click Delete in the Actions column.
In the Delete Queue dialog box, click Delete Queue.
Related documents
For more information about how to create and run workflows, see Manage workflows.
For more information about operations related to permissions, see Manage users and roles.
For more information about operations related to SQL sessions, see Manage SQL sessions.