DataWorks provides the exclusive resource group mode that allows you to create exclusive resource groups and assign them to workspaces to run nodes. This topic describes how to purchase exclusive resources and create, view, manage, and use exclusive resource groups.
Background information
- Resources of different users are isolated.
- Resources that are used to run nodes in different workspaces are isolated.
- Exclusive resources can be scaled in or out. You can use and flexibly configure exclusive resources.
RAM users to which the AliyunBSSOrderAccess policy is attached can create exclusive resource groups and perform operations on them.
Purchase exclusive resources
- Go to the product page
- Open the Create a dedicated resource group panel
- Log on to the DataWorks console.
- In the left-side navigation pane, click Resource Groups. The Exclusive Resource Groups tab appears.
- If you have not purchased exclusive resources in the current region, click Create Resource Group for Scheduling or Create Resource Group for Data Integration.
- In the Create a dedicated resource group panel, click Purchase next to Order Number to go to the buy page.
On the buy page, set the Region, Type, Exclusive Resources for Scheduling, Units, and Duration parameters as required and click Buy Now.
Create an exclusive resource group
- On the Resource Groups page, click Create Resource Group for Scheduling or Create Resource Group for Data Integration. tab of the
- In the Create a dedicated resource group panel, set the parameters as required.
Parameter Description Resource Group Type The type of the resource group. Exclusive resource groups are classified into exclusive resource groups for scheduling and exclusive resource groups for Data Integration. The former type is used to schedule general nodes and the latter type is used to run sync nodes. Resource Group Name The name of the resource group. The name must be unique within the current tenant. Note A tenant refers to an Alibaba Cloud account. Each tenant may have multiple RAM users.Resource Group Description The description of the resource group. Order Number The ID of the order that you placed to purchase the exclusive resources. If you have not purchased exclusive resources, click Purchase. - After the configuration is complete, click OK.
Note The exclusive resource group is initialized within 20 minutes. Wait until its status changes to Running.
View an exclusive resource group
- Valid Until: the time when the exclusive resource group expires. The expiration time is determined
based on the duration that you set when you placed the relevant order.
- You can renew an exclusive resource group before it expires. If an exclusive resource group is not renewed after it expires, the exclusive resource group is in the Expired state and cannot be used for new nodes.
- You can activate an expired exclusive resource group within seven days after it expires. If you do not activate an exclusive resource group within seven days after it expires, it is released.
- Groups: the quantity of resources that you purchased.
- Resource Group Usage: the usage of the resource group in percentage.
Manage an exclusive resource group
- Scale Out
If the usage of an exclusive resource group remains high or fails to meet your business requirements, find the exclusive resource group and click Scale Out in the Actions column. You can purchase more resources for the resource group.
- Scale In
If an exclusive resource group is sometimes idle, find the exclusive resource group and click Scale In in the Actions column. You can decrease the quantity of resources in the resource group.
- Renew
To extend the validity period of an exclusive resource group, find the exclusive resource group and click Renew in the Actions column.
- Network SettingsExclusive resource groups are deployed in a virtual private cloud (VPC) that is managed by DataWorks. If you want to connect an exclusive resource group to a data source in your own VPC, you must associate the exclusive resource group with your VPC.
- Find the required resource group and click Network Settings in the Actions column to associate the resource group with a VPC on the VPC Binding tab.
Before the association, authorize DataWorks to access your cloud resources in the RAM console.
- After the authorization is complete, click Add Binding.
- In the Add VPC Binding panel, set the parameters as required. Notice You must associate the exclusive resource group with the VPC which the required data source is located in or connected to.
If you want to use an exclusive resource group to access a data source in a data center or access a data source across Alibaba Cloud accounts or regions, you must associate the exclusive resource group with the VPC to which the data source is connected. For more information, see Create and use an exclusive resource group for Data Integration. You must also add a custom route entry when you associate the exclusive resource group with the VPC. For more information, see Add a route.
If relevant information changes after the association, find the resource group and click Unbind. Then, you can associate the resource group with the VPC again.
- Find the required resource group and click Network Settings in the Actions column to associate the resource group with a VPC on the VPC Binding tab.
- Change Workspace
You must associate an exclusive resource group with a workspace so that the exclusive resource group can be used by nodes in the workspace. You can associate an exclusive resource group with multiple workspaces.
- Change SpecificationsIf the specifications of an exclusive resource group cannot meet your business requirements, find the exclusive resource group and click Change Specifications in the Actions column. In the Change Specifications of Resource Group dialog box, change the specifications. For information about available specifications of resource groups, see Performance metrics and Performance metrics.Note When you change the specifications, you change server resources for the resource group. After the payment is complete, if node instances are running on the resource group, they are listed in the Stop Node Instance step. Click Stop Now in the Actions column of the required node instances to stop the node instances, or change the specifications after the execution of the node instances is complete. Otherwise, you cannot change the specifications of the resource group.
Use an exclusive resource group
After an exclusive resource group is associated with a workspace, you can assign the exclusive resource group to nodes in the workspace.
- Exclusive resource groups for scheduling
- Log on to the DataWorks console.
- In the left-side navigation pane, click Workspaces.
- Find the required workspace and click Data Analytics in the Actions column.
- On the DataStudio page, double-click the required node. The node configuration tab appears.
- Click the Properties tab in the right-side navigation pane.
- In the Resource Group section, select a resource group from the Resource Group drop-down list.
- Exclusive resource groups for Data Integration
After you create an exclusive resource group for Data Integration, you can select it when you configure a data integration node.
- On the Resource Groups page, find the required exclusive resource group and click Change Workspace. Associate the exclusive resource group for Data Integration with a workspace. tab of the
- On the configuration tab of a batch sync node, configure scheduling properties, test
the node, and then select the resource group that is used to run the node.
- Click the
icon in the upper-left corner and choose . Switch to the required workspace.
- In the Scheduled Workflow pane, double-click the required node to go to the node configuration tab.
- Click the Resource Group configuration tab in the right-side pane.
- In the Resource Group configuration panel, select the required resource group type and resource group.
- On the configuration tab of the node, click the
icon in the toolbar.
- Click the