DataWorks provides shared resource groups that you can use to create and run your nodes.
- Shared resource groups compose a public resource pool. Nodes that use resources in the public resource pool may not be run as scheduled due to insufficient resources. To make sure that your nodes can be run as scheduled, use an exclusive resource group. For more information, see Create and use an exclusive resource group for Data Integration and Create and use an exclusive resource group for scheduling.
- You need to provide information about a shared resource group when you configure network connectivity. For more information, see Configure a security group for an ECS instance where a self-managed data store resides and Configure whitelists.
- You can run a maximum of 25 concurrent nodes on a shared resource group for Data Integration when the shared resource group is not in use. When you run nodes on a shared resource group, resources may be preempted. Therefore, the maximum number of nodes that can be concurrently run may be less than 25.
- You cannot change the memory size of a shared resource group. Instead, you can change
the number of concurrent nodes that can be run on the shared resource group.
The following formula is used to calculate the memory size: Memory size =
Number of concurrent nodes × 512 MB.