edit-icon download-icon

Scheduling resource list

Last Updated: Mar 20, 2018

On the Alibaba Cloud DTplus console, you can view all the scheduling resources under the current account on the Scheduling Resource List page. On this page, you can create scheduling resources, search for a resource by entering its name, and can also perform operations on the expected resource.

Procedure

  1. Log on to the DataWorks product details page as an organization administrator (main account).

  2. Click DataWorks console to enter the console overview page.

  3. Navigate to the Scheduling Resource List page.

    • Description of the items listed on this page is as follows:

      • Resource name: The name of the scheduling resource group, which consists of letters (a-z), underscores(_), and numbers (0-9) with a length no greater than 60 characters. Once created, the name cannot be changed.

      • Network type: The network type used by the ECS server is added as a scheduling resource. The types include VPC and classic networks:

        • Classic network: IP addresses are centrally allocated by Alibaba Cloud. Classic networks are easy to configure and use. This network type is suitable for users who demand quick accessibility to ECS and emphasize on easy and convenient operations

        • VPC: A VPC is a logically isolated private network. Network topologies and IP addresses can be customized. VPC supports private line connection and is suitable for users who are familiar with network management.

      • Server: The name of the server contained in the current scheduling resource.

      • Operation type:

        • Initialize the server: Enter a machine initialization statement as prompted.

        • Modify the server: Modify server configurations of the current scheduling resource, such as adding or deleting a server and changing the maximum number of concurrent server tasks.

      • Modify owner project: You can allocate the current scheduling resource to a specific project. This operation can only be performed by the main account that activated the service. After creating the project, you can use an existing ECS by modifying the owner project.

    • Add scheduling resources: For more information, see Add scheduling resources.

FAQs

What are scheduling resources?

Scheduling resources are used to perform or distribute the tasks from the scheduling system. The scheduling resources of DataWorks are divided into the following two types:

  • Default scheduling resource

  • Custom scheduling resource

    Custom scheduling resources are the user-purchased ECSs, which can be configured as scheduling servers for performing distributed tasks. The organization administrator (main account) can create custom scheduling resources, which contain several physical machines or ECSs to perform data synchronization, SHELL, ODPS_SQL, and OPEN_MR tasks.

Why do I need to add custom scheduling resources?

You can purchase ECSs and configure them as scheduling resources when a number of tasks are waiting for resources and slots or when you are running Shell and OPEN_MR tasks, which improves the efficiency in running scheduling tasks.

Note:

By default, each task runs or is distributed in the default scheduling resource group. To change the resource group, navigate to O&M Center > Task Management > Change Resource Group. ODPS_SQL tasks can only run in the default resource group. If you must run SQL tasks in a custom resource group, change the default resource group in Scheduling Resources under Project Management.

Thank you! We've received your feedback.