DataWorks provides you with the exclusive resource group mode, which allows you to purchase exclusive resource groups and assign them to workspaces to run nodes. This topic describes how to purchase, create, view, manage, and use exclusive resource groups.

Background information

In exclusive resource group mode, physical resources such as the network, disk, CPU, and memory are completely exclusive. The exclusive resource group mode has the following features:
  • Resources of different users are isolated.
  • Resources that are used to run nodes in different workspaces are isolated.
  • Exclusive resources can be scaled in or out. You can use and flexibly configure exclusive resources.
An exclusive resource group can be connected to data stores in virtual private clouds (VPCs) in the same region and Relational Database Service (RDS) instances across regions by using public endpoints.
Note The peak hours for DataWorks tenants to run nodes are from 00:00 to 09:00 each day. If you use shared resource groups during the peak hours, you share resources with other tenants.

When tenants share resources, some tenants may preempt the resources. If you have high requirements on the output time of nodes, use exclusive resource groups to run the nodes. Regardless of the edition of DataWorks, you do not need to pay extra fees for node instances that are run on an exclusive resource group.

Purchase an exclusive resource group

You can purchase DataWorks exclusive resource groups based on the subscription billing method. To purchase an exclusive resource group, you can go to the product page or click Create a dedicated resource group.
  • Go to the product page
  • Click Create a dedicated resource group
    1. Log on to the DataWorks console.
    2. In the left-side navigation pane, click Resource Groups. The Exclusive Resource Groups tab appears.
    3. If you have not purchased an exclusive resource group in the current region, click Create a dedicated resource group.
    4. In the Create a dedicated resource group panel, click Purchase next to Order Number to go to the buy page.Purchase

On the buy page, set the Region, Type, Exclusive scheduling resources, Units, and Duration parameters as required and click Buy Now.

Note Exclusive resource groups cannot be shared among regions. For example, an exclusive resource group in the China (Shanghai) region can be used only by workspaces in the China (Shanghai) region.

Create an exclusive resource group

  1. On the Exclusive Resource Groups tab of the Resource Groups page, click Create a dedicated resource group.
  2. In the Create a dedicated resource group panel, set the parameters as required.
    Parameter Description
    Resource Group Type The type of the resource group. Exclusive resource groups are classified into exclusive resource groups for scheduling and exclusive resource groups for Data Integration. The former is used to schedule general nodes and the latter is used to run sync nodes.
    Resource Group Name The name of the resource group. The name must be unique within all resource groups of a tenant.
    Note A tenant indicates an Alibaba Cloud account. Multiple RAM users may exist under a tenant.
    Resource Group Description The description of the resource group.
    Order Number The number of the order that you place on the exclusive resource group. If you have not purchased one, click Purchase.
  3. After the configuration is completed, click OK.
    Note The exclusive resource group is initialized within 20 minutes. Wait patiently until its status changes to Running.

View an exclusive resource group

After you create an exclusive resource group, you can view basic information, such as the expiration time, resource quantity, and resource group usage, in the exclusive resource group list.
  • Valid Until: the time when the exclusive resource group expires. The expiration time is based on the duration that you set when you purchase the exclusive resource group.
    • You can renew an exclusive resource group before it expires. If an exclusive resource group is not renewed after it expires, the exclusive resource group is in the Expired state and cannot be used for new nodes.
    • You can activate an expired exclusive resource group within seven days. If you do not activate an exclusive resource group within seven days after it expires, it is released.
  • Groups: the quantity of resources that you purchase.
  • Resource Group Usage: the usage of the resources in percentage.

Manage an exclusive resource group

After you create an exclusive resource group, you can manage it in the exclusive resource group list. For example, you can scale or renew the exclusive resource group, bind the exclusive resource group to a VPC, or change the workspace to which the exclusive resource group belongs.
  • Scale Out

    If the usage of an exclusive resource group remains high or fails to meet your business requirements, find the exclusive resource group and click Scale Out. You can increase the quantity of resources.

  • Scale In

    If an exclusive resource group is sometimes idle, find the exclusive resource group and click Scale In. You can decrease the quantity of resources.

  • Renew

    Find an exclusive resource group and click Renew. You can extend the validity period of the exclusive resource group.

  • Add VPC Binding
    Exclusive resource groups are deployed in a VPC that is managed by DataWorks. If you want to connect an exclusive resource group to a data store in your own VPC, you must bind the exclusive resource group to your VPC.
    1. Find the exclusive resource group and click Add VPC Binding to go to the binding page.

      Before the binding, authorize DataWorks to access your cloud resources in the RAM console.

    2. After the authorization is completed, click Add Binding.
    3. In the Add VPC Binding panel, set the parameters as required.
      Notice The exclusive resource group and the data store to be connected must be in the same zone. When you bind a VPC, select the vSwitch to which the data store is bound.

      If the exclusive resource group and the data store to be connected are bound to the same VPC but reside in different zones, add a custom route when you bind a VPC. For more information, see Add a route.

    If relevant information changes after the binding, find the resource group and click Unbind. Then, you can bind the resource group again.

  • Change Workspace

    You must bind an exclusive resource group to a workspace so that the exclusive resource group can be used by nodes in the workspace. You can bind an exclusive resource group to multiple workspaces.

Use an exclusive resource group

After an exclusive resource group is bound to a workspace, you can assign the exclusive resource group to nodes in the workspace.

Exclusive resource groups are classified into exclusive resource groups for scheduling and exclusive resource groups for Data Integration.
  • Exclusive resource groups for scheduling
    1. Log on to the DataWorks console.
    2. In the left-side navigation pane, click Workspaces.
    3. Find the required workspace and click Data Analytics.
    4. Change the resource group for scheduling for a node.
      You can change the resource group for scheduling for a node in one of the following ways:
      • Change the resource group for scheduling for multiple nodes at a time on the Nodes tab in DataStudio.
        1. Go to the DataStudio page.
        2. Click the Nodes icon on the right side of Business Flow.
        3. On the Nodes tab, select one or more nodes for which you want to change the resource group for scheduling and click Modify Scheduling Resource Group in the lower-right corner.
        4. In the Modify Scheduling Resource Group dialog box, select the required resource group, set the Force modification parameter, and then enter yes to indicate that you are aware of the risk and want to confirm the action.
        5. Click OK to change the resource group for scheduling for multiple nodes at a time.
      • Change the resource group for scheduling for a node in Operation Center
        1. Click the Icon icon in the upper-left corner and choose All Products > Task Operation > Operation Center. In Operation Center, switch to the required workspace.
        2. In the left-side navigation pane, choose Cycle Task Maintenance > Cycle Task.
        3. Click the rightwards arrow in the middle of the page to show the node list. Find the required node, and choose MoreModifying a scheduling Resource Group.Change the resource group
          Notice You are not allowed to change the resource group for zero load nodes, workflow nodes, or Machine Learning experiment nodes.
          To change the resource group for multiple nodes at a time, select the required nodes on the Cycle Task page and click Modifying a scheduling Resource Group in the lower part of the page.Change the resource group for multiple nodes at a time
        4. In the Modify scheduling resource groups in batches dialog box, select the required resource group for scheduling and click OK.
      • Change the resource group for scheduling for a node on the Properties tab
        1. Click the Icon icon in the upper-left corner and choose All Products > Data Development > DataStudio. Switch to the required workspace.
        2. On the Data Analytics tab, double-click the required node to go to the node configuration tab.
        3. In the right-side navigation pane, click the Properties tab. In the Resource Group section, select the required resource group for node scheduling.Resource Group

        You can also click the Run icon on the node configuration tab. In the Arguments dialog box, select the required resource group for scheduling to run a test for the node on the DataStudio page and click OK.

  • Exclusive resource groups for Data Integration
    After you create an exclusive resource group for Data Integration, you can select it when you configure a data integration node.
    Note
    • If your data center is connected to an Alibaba Cloud VPC, you can use an exclusive resource group for Data Integration to run sync nodes. After you purchase an exclusive resource group for Data Integration,submit a ticket. For more information, see Exclusive resources for Data Integration.
    • You cannot use an exclusive resource group for Data Integration to synchronize data from a data store in a VPC in one region to a data store in a VPC in another region.
    • To perform operations on exclusive resource groups for Data Integration, such as adding routes, submit a ticket.
    • When you use an exclusive resource group for Data Integration, make sure that the VPC to which the exclusive resource group for Data Integration is bound has access to the host where the data store to be connected resides. If the access is blocked by security settings, allow the access on the whitelist by adding the Classless Inter-Domain Routing (CIDR) block of the VPC to the whitelist of the data store.
    1. On the Exclusive Resource Groups tab of the Resource Groups page, find the required exclusive resource group and click Change Workspace. Bind the exclusive resource group for Data Integration to a workspace.
    2. On the configuration tab of a data integration node, configure scheduling properties, test the node, and then select the resource group that is used to run the batch sync node.
      1. Click the Icon icon in the upper-left corner and choose All Products > Data Development > DataStudio. Switch to the required workspace.
      2. On the Data Analytics tab, double-click the required node. The node configuration tab appears.
      3. In the right-side navigation pane, click the Resource Group configuration tab.
      4. On the Resource Group configuration tab, set the Programme parameter and select the required resource group.
      5. On the node configuration tab, click the Save icon in the toolbar.