Configure the resource group for your integration task based on the business scenario to optimize resource utilization. This topic explains how to set up the resource configuration for your integration task.
Procedure
On the Dataphin home page, navigate to Development > Data Integration from the top menu bar.
At the top menu bar of the Integration page, select Project.
In the left-side navigation pane, go to Integration > Batch Pipeline. In the Batch Pipeline list, click the desired task name.
In the task tab, click Attribute on the right to open the Attribute panel.
In the task's Attribute drawer, set up the task's resources in the Resource Configuration section.
Parameter
Description
Development Task Schedule Resource Group, Production Task Schedule Resource Group
Configure the Development Task Schedule Resource Group and Production Task Schedule Resource Group when the project is in Dev-Prod mode. In Basic mode, only the Production Task Schedule Resource Group can be set.
Offline integration task scheduling requires schedule resources. Designate the schedule resource group for each instance created by the offline integration task. During scheduling, resources are allocated from the chosen resource group's quota. If resources are insufficient, the task will be placed in a Waiting for schedule resource status. Resource groups are isolated to ensure stable scheduling.
To set the schedule resource group, you can only select resource groups that are designated for the Task daily scheduling scenario and are associated with the current task's project. For detailed instructions, see Resource group configuration.
NoteSelecting the Project default resource group will automatically update it according to the Project default resource group configuration.
Click OK to finalize the offline integration pipeline task resource configuration.
What to do next
Once the task resource configuration is complete, click Submit to send the task to the publishing center or operation center.
In Dev-Prod mode, you must publish the task. For more information, see Manage Publishing Tasks.
In Basic mode, after successful submission, the task is ready for production environment scheduling. Visit the operation center to monitor your published tasks. For details, see Operation Center.