DataWorks provides the exclusive resource group mode that allows you to create exclusive resource groups and assign them to workspaces to run nodes. This topic describes how to purchase exclusive resources and create, view, manage, and use exclusive resource groups.

Background information

In exclusive resource group mode, physical resources such as the networks, disks, CPU, and memory are completely exclusive. The exclusive resource group mode has the following features:
  • Resources of different users are isolated.
  • Resources that are used to run nodes in different workspaces are isolated.
  • Exclusive resources can be scaled in or out. You can use and flexibly configure exclusive resources.
Note If you use shared resource groups, you share resources with other tenants. The peak hours for DataWorks tenants to run nodes are from 00:00 to 09:00 each day. If you want to run a large number of nodes during peak hours in your workspace, we recommend that you use an exclusive resource group. For more information about exclusive resource groups, see Create and use an exclusive resource group for scheduling and Create and use an exclusive resource group for Data Integration.

RAM users to which the AliyunBSSOrderAccess policy is attached can create exclusive resource groups and perform operations on them.

Purchase exclusive resources

You can purchase DataWorks exclusive resources based on the subscription billing method. To purchase exclusive resources, you can go to the product page or open the Create a dedicated resource group panel.
  • Go to the product page
  • Open the Create a dedicated resource group panel
    1. Log on to the DataWorks console.
    2. In the left-side navigation pane, click Resource Groups. The Exclusive Resource Groups tab appears.
    3. If you have not purchased exclusive resources in the current region, click Create Resource Group for Scheduling or Create Resource Group for Data Integration.
    4. In the Create a dedicated resource group panel, click Purchase next to Order Number to go to the buy page. Purchase

On the buy page, set the Region, Type, Exclusive Resources for Scheduling, Units, and Duration parameters as required and click Buy Now.

Note Exclusive resource groups cannot be shared among regions. For example, an exclusive resource group in the China (Shanghai) region can be used only by workspaces in the China (Shanghai) region.

Create an exclusive resource group

  1. On the Exclusive Resource Groups tab of the Resource Groups page, click Create Resource Group for Scheduling or Create Resource Group for Data Integration.
  2. In the Create a dedicated resource group panel, set the parameters as required.
    Parameter Description
    Resource Group Type The type of the resource group. Exclusive resource groups are classified into exclusive resource groups for scheduling and exclusive resource groups for Data Integration. The former type is used to schedule general nodes and the latter type is used to run sync nodes.
    Resource Group Name The name of the resource group. The name must be unique within the current tenant.
    Note A tenant refers to an Alibaba Cloud account. Each tenant may have multiple RAM users.
    Resource Group Description The description of the resource group.
    Order Number The ID of the order that you placed to purchase the exclusive resources. If you have not purchased exclusive resources, click Purchase.
  3. After the configuration is complete, click OK.
    Note The exclusive resource group is initialized within 20 minutes. Wait until its status changes to Running.

View an exclusive resource group

After you create an exclusive resource group, you can view its basic information, such as the expiration time, resource quantity, and resource group usage, in the exclusive resource group list.
  • Valid Until: the time when the exclusive resource group expires. The expiration time is determined based on the duration that you set when you placed the relevant order.
    • You can renew an exclusive resource group before it expires. If an exclusive resource group is not renewed after it expires, the exclusive resource group is in the Expired state and cannot be used for new nodes.
    • You can activate an expired exclusive resource group within seven days after it expires. If you do not activate an exclusive resource group within seven days after it expires, it is released.
  • Groups: the quantity of resources that you purchased.
  • Resource Group Usage: the usage of the resource group in percentage.

Manage an exclusive resource group

After you create an exclusive resource group, you can manage it in the exclusive resource group list. For example, you can scale in, scale out, or renew the exclusive resource group, configure network settings, or change the workspace to which the exclusive resource group belongs.
  • Scale Out

    If the usage of an exclusive resource group remains high or fails to meet your business requirements, find the exclusive resource group and click Scale Out in the Actions column. You can purchase more resources for the resource group.

  • Scale In

    If an exclusive resource group is sometimes idle, find the exclusive resource group and click Scale In in the Actions column. You can decrease the quantity of resources in the resource group.

  • Renew

    To extend the validity period of an exclusive resource group, find the exclusive resource group and click Renew in the Actions column.

  • Network Settings
    Exclusive resource groups are deployed in a virtual private cloud (VPC) that is managed by DataWorks. If you want to connect an exclusive resource group to a data source in your own VPC, you must associate the exclusive resource group with your VPC.
    1. Find the required resource group and click Network Settings in the Actions column to associate the resource group with a VPC on the VPC Binding tab.

      Before the association, authorize DataWorks to access your cloud resources in the RAM console.

    2. After the authorization is complete, click Add Binding.
    3. In the Add VPC Binding panel, set the parameters as required. Add Binding
      Notice You must associate the exclusive resource group with the VPC which the required data source is located in or connected to.

      If you want to use an exclusive resource group to access a data source in a data center or access a data source across Alibaba Cloud accounts or regions, you must associate the exclusive resource group with the VPC to which the data source is connected. For more information, see Create and use an exclusive resource group for Data Integration. You must also add a custom route entry when you associate the exclusive resource group with the VPC. For more information, see Add a route.

    If relevant information changes after the association, find the resource group and click Unbind. Then, you can associate the resource group with the VPC again.

  • Change Workspace

    You must associate an exclusive resource group with a workspace so that the exclusive resource group can be used by nodes in the workspace. You can associate an exclusive resource group with multiple workspaces.

  • Change Specifications
    If the specifications of an exclusive resource group cannot meet your business requirements, find the exclusive resource group and click Change Specifications in the Actions column. In the Change Specifications of Resource Group dialog box, change the specifications. For information about available specifications of resource groups, see Performance metrics and Performance metrics. Change Specifications
    Note When you change the specifications, you change server resources for the resource group. After the payment is complete, if node instances are running on the resource group, they are listed in the Stop Node Instance step. Click Stop Now in the Actions column of the required node instances to stop the node instances, or change the specifications after the execution of the node instances is complete. Otherwise, you cannot change the specifications of the resource group.

Use an exclusive resource group

After an exclusive resource group is associated with a workspace, you can assign the exclusive resource group to nodes in the workspace.

Exclusive resource groups are classified into exclusive resource groups for scheduling and exclusive resource groups for Data Integration.
  • Exclusive resource groups for scheduling
    1. Log on to the DataWorks console.
    2. In the left-side navigation pane, click Workspaces.
    3. Find the required workspace and click Data Analytics in the Actions column.
    4. On the DataStudio page, double-click the required node. The node configuration tab appears.
    5. Click the Properties tab in the right-side navigation pane.
    6. In the Resource Group section, select a resource group from the Resource Group drop-down list. Exclusive resource groups for scheduling
  • Exclusive resource groups for Data Integration
    After you create an exclusive resource group for Data Integration, you can select it when you configure a data integration node.
    1. On the Exclusive Resource Groups tab of the Resource Groups page, find the required exclusive resource group and click Change Workspace. Associate the exclusive resource group for Data Integration with a workspace.
    2. On the configuration tab of a batch sync node, configure scheduling properties, test the node, and then select the resource group that is used to run the node.
      1. Click the Icon icon in the upper-left corner and choose All Products > Data Development > DataStudio. Switch to the required workspace.
      2. In the Scheduled Workflow pane, double-click the required node to go to the node configuration tab.
      3. Click the Resource Group configuration tab in the right-side pane.
      4. In the Resource Group configuration panel, select the required resource group type and resource group. Change the exclusive resource group
      5. On the configuration tab of the node, click the Save icon in the toolbar.