DataWorks allows you to associate an exclusive resource group for scheduling with a virtual private cloud (VPC) so that the resource group can access data sources in the VPC.
Prerequisites
Background information
- To allow an exclusive resource group for scheduling to access the data sources in a VPC, you must associate the exclusive resource group with the VPC and then with a vSwitch that resides in the VPC. Then, the system adds a route for the exclusive resource group. The destination of this route is the CIDR block of the VPC. This ensures that the exclusive resource group can access all data sources in this VPC.
- If a whitelist is configured for a data source that you want to access and the data source is accessed over the Internet, add the Elastic IP address (EIP) of the exclusive resource group for scheduling to the whitelist. If the data source is accessed over an internal network, add the CIDR block of the vSwitch to the whitelist and security group of the data source. The vSwitch is the one that is associated with the exclusive resource group for scheduling. For more information, see Add the exclusive resource group for scheduling to the whitelist of the data source to be accessed.
The maximum number of concurrent instances that are allowed by an exclusive resource group for scheduling is determined by the specifications of resources in the resource group. For more information, see Performance metrics and pricing of exclusive resource groups for scheduling.
Create an exclusive resource group for scheduling
Associate the exclusive resource group with a VPC
Exclusive resource groups are deployed in a VPC that is managed by DataWorks. To allow exclusive resource groups to access data sources in your own VPC, you must associate the exclusive resource groups with your VPC.
Add the exclusive resource group for scheduling to the whitelist of the data source to be accessed
- If the data source is accessed over an internal network, add the CIDR block of the
vSwitch that resides in the VPC to the whitelist. The vSwitch is the one that is associated
with the exclusive resource group for scheduling.
To view the CIDR block after you associate the exclusive resource group with the VPC, log on to the DataWorks console and click Exclusive Resource Groups tab, find the exclusive resource group and click Network Settings in the Actions column. On the VPC Binding tab, view the value in the VSwitch CIDR Block column.in the left-side navigation pane. On the
- If the data source is accessed over the Internet, add the EIP and CIDR block of the
exclusive resource group for scheduling to the whitelist.
- Log on to the DataWorks console.
- In the left-side navigation pane, click Resource Groups.
- On the Exclusive Resource Groups tab, find the required resource group and click View Information in the Actions column.
- In the Exclusive Resource Groups dialog box, copy the values of the EIPAddress and CIDR Blocks parameters. Then, add the EIP and CIDR block to the whitelist of the data source.
Associate the exclusive resource group with a workspace
- On the Exclusive Resource Groups tab of the page, find the required resource group and click Change Workspace in the Actions column.
- In the Modify home workspace dialog box, click Bind in the Actions column of the workspace with which the resource group is to be associated.
- Associate the exclusive resource group with a workspace.
You must associate an exclusive resource group for scheduling with a workspace before you can select the resource group in the workspace. You can associate an exclusive resource group for scheduling with multiple workspaces.
- On the Exclusive Resource Groups tab of the page, find the required resource group and click Change Workspace in the Actions column.
- In the Modify home workspace dialog box, click Bind in the Actions column of the workspace with which the resource group is to be associated.
- Change the exclusive resource group that is used to test a node on the DataStudio
page.
- On the DataStudio page, double-click the required node. The node configuration tab appears.
- Click the
icon in the top toolbar.
- In the Parameters dialog box, set the Resource Group parameter to the exclusive resource group that is used to test the node.
- Click OK.
- Change the exclusive resource group that is used to schedule a node.
You can change the exclusive resource group that is used to schedule a node in the Properties panel or in Operation Center.
- Change the resource group for scheduling for a node in the Properties panel
- Click the
icon in the upper-left corner and choose . Switch to the required workspace.
- In the Scheduled Workflow pane, double-click the required node in the Business Flow directory to go to the configuration tab of the node.
- In the right-side navigation pane, click the Properties tab. The Properties panel appears. In the Resource Group section, select the required exclusive resource group for scheduling from the drop-down
list. For more information, see Configure a resource group.
- Click the
- Change the resource group for scheduling for a node in Operation Center
- Click the
icon in the upper-left corner and choose . In Operation Center, switch to the required workspace.
- In the left-side navigation pane, choose .
- Click the rightwards arrow in the middle of the page to show the node list. Find the
required node, and choose Notice You are not allowed to change the resource group for zero load nodes, workflow nodes, or Machine Learning experiment nodes.To change the exclusive resource group for multiple nodes at a time, select the nodes on the Cycle Task page and click Modify Scheduling Resource Group in the lower part of the page.
in the Actions column.
- In the Modify Scheduling Resource Group dialog box, select the required exclusive resource group for scheduling from the drop-down list and click OK.
- Click the
- Change the resource group for scheduling for a node in the Properties panel