Dataphin:Create a custom resource group

Limits

Each tenant can create up to 100 resource groups, including the tenant default resource group.

Permissions

Custom roles with Manage Resource Settings permission and system roles including super administrator and system administrator can create custom resource groups.

Procedure

1. On the Dataphin home page, select Management Center > System Settings from the top menu bar.

2. In the left-side navigation pane, select Tenant Settings > Resource Settings.

3. Under the Resource Group Configuration tab, click + Create Custom Resource Group.

4. In the Create Custom Resource Group dialog box, configure the parameters.

   Parameter	Description
   Resource Group Name	The resource group name. Up to 128 characters.
   Owner	The owner of the resource group. You can search by username.
   Cluster	The cluster that the resource group belongs to. You can choose the default cluster, , or a custom cluster available to the current tenant (a cluster associated with all tenants or specified for the current tenant). Note The cluster cannot be modified after creation.
   Schedule Resource Settings	CPU and Memory: Set the CPU and Memory with the Active Upper Limit and Active Lower Limit respectively. When the cluster is selected as default cluster: Available lower limit: Available lower limit = percentage (%) * tenant lower limit. Enter a percentage accurate to one decimal place. The default is empty. Remaining resources = 1 - the total allocated to other resource groups from the current tenant's resource lower limit (percentage). The available lower limit cannot exceed the remaining resources. Available upper limit: Available upper limit = percentage (%) * tenant upper limit. Enter a percentage accurate to one decimal place. The default is 100%. The available upper limit cannot be lower than the available lower limit. When the cluster is selected as registered external cluster: Available lower limit: Available lower limit = percentage (%) * total cluster amount. Enter a percentage accurate to one decimal place. The default is empty. Remaining resources = 1 - the total allocated to other resource groups from the total cluster amount (percentage), where the total cluster amount is the total amount of the selected cluster in the above configuration. The available lower limit cannot exceed the remaining resources. Available upper limit: Available upper limit = percentage (%) * total cluster amount. Enter a percentage accurate to one decimal place. The default is 100%. The available upper limit cannot be lower than the available lower limit. Note The available lower limit represents guaranteed resources for the resource group. When tenant resources are tight, each resource group is prioritized to receive its configured lower limit. Unused lower-limit resources of this resource group can be borrowed by other resource groups within the same tenant. When this resource group needs those resources back, borrowed resources are reclaimed through queuing. This resource group can also borrow unused quotas from other resource groups within the same tenant, but the total resources after borrowing cannot exceed the configured available upper limit. Resource groups can only borrow resources from other resource groups in the same cluster. Description: A brief description of the resource group. Maximum 1000 characters. Scenario: Includes offline task and real-time task scenarios. Offline tasks: Supports daily scheduling and batch operations for offline tasks. Batch operations: Resource groups available for batch operations such as batch data backfill. A resource group configured for batch operations applies only to the instances covered by that batch operation. Task daily scheduling: The resource group used for task trial runs, smoke testing, recurring schedules, and other operations. You must configure the associated projects that can use the resource group. After configuration, you can select the associated resource group as the project's default resource group in project settings. For more information, see the referenced document. Real-time tasks: Available after enabling real-time development in tenant settings. Real-time task custom resource groups support Dataphin clusters and registered schedule clusters. The created real-time task resource group can be used for Session cluster task testing and real-time task execution. When the scenario is set to real-time tasks, configuring available upper and lower limits of CPU/memory is not supported. You only need to enter the percentage values of CPU and memory. Session cluster task testing: Creates a Session cluster for real-time task testing. Note The minimum specification requirement for a Session cluster is 3C 12G. Each tenant can create only one custom resource group with the Session cluster scenario. All projects under this tenant share this resource group. Only custom resource groups for real-time tasks support creating Session clusters for real-time task testing. Real-time task execution: Allocates computing resources in the Flink on K8s (Kubernetes) deployment mode. Note When the schedule cluster is selected as non-default cluster (that is, an external registered cluster), the real-time task application scenario only supports real-time task execution. For resource group priority rules, see the referenced document.

5. Click OK to complete the custom resource group configuration.

   Resource group configuration changes may take approximately 5 minutes to take effect.