Scheduling resource list

Last Updated: Nov 12, 2017

On the Alibaba Cloud DTplus console, you can view all the scheduling resources under the current account on the Scheduling Resource List page. Also, you can create scheduling resources, search for a resource by entering its name, and perform operations on the expected resource on this page.

Procedure

  1. Log on to the DataWorks product details page as an organization administrator (main account).

  2. Click DataWorks console to enter the console overview page.

  3. Navigate to the Scheduling Resource List page.

    • Concepts of listed items on this page:

      • Resource name: The name of the scheduling resource group, which consists of letters (a-z), underscores(_), and numbers (0-9) with a length no greater than 60 characters. Once created, the name cannot be changed.

      • Network type: The network type used by the ECS server added as a scheduling resource. The types include VPC and classic networks:

        • Classic network: IP addresses are centrally allocated by Alibaba Cloud. Classic networks are easy to configure and use. This network type is suitable for users who require high ease of operation and need to use the ECS quickly.

        • VPC: A VPC is a logically isolated private network. Network topologies and IP addresses can be customized. VPC supports private line connection and is suitable for users who are familiar with network management.

      • Server: The name of the server contained in the current scheduling resource.

      • Operation type:

        • Initialize the server: Enter a machine initialization statement as prompted.

        • Modify the server: Modify the server configurations of the current scheduling resource, including adding or deleting a server and changing the maximum number of concurrent server tasks.

      • Modify owner project: You can allocate the current scheduling resource to a specific project. This operation can only be performed by the main account that activated the service. After creating the project, you can use an existing ECS by modifying the owner project.

    • Add scheduling resources: See Add scheduling resources for details.

What are scheduling resources?

Scheduling resources are used to perform or distribute the tasks from the scheduling system. The scheduling resources of DataWorks are divided into the following two types:

  • Default scheduling resource

  • Custom scheduling resource

    Custom scheduling resources refer to the user-purchased ECSs, which can be configured as scheduling servers for performing distributed tasks. The organization administrator (main account) can create custom scheduling resources, which contain several physical machines or ECSs for performing data synchronization, SHELL, ODPS_SQL, and OPEN_MR tasks.

Why do I need to add custom scheduling resources?

You can purchase ECSs and configure them as scheduling resources when a number of tasks are waiting for resources and slots or when you are running Shell and OPEN_MR tasks, which improves the efficiency in running scheduling tasks.

Note:

By default, each task is run or distributed in the default scheduling resource group. To change the resource group, navigate to O&M Center > Task Management > Change Resource Group. ODPS_SQL tasks can only run in the default resource group. If you need to run SQL tasks in a custom resource group, change the default resource group in Scheduling Resources under Project Management.

Thank you! We've received your feedback.