You can configure task-level timeout periods and rerun policies for failed tasks based on your business scenarios. This helps prevent resource waste caused by long-running offline pipeline tasks while improving the reliability of offline pipeline task execution. This topic describes how to configure the running configuration of offline pipeline tasks.
Procedure
In the top navigation bar of the Dataphin homepage, choose Develop > Data Integration.
In the top menu bar of the Integration page, select a project (In Dev-Prod mode, you also need to select an environment).
Click Batch Pipeline in the left-side navigation pane, and select the offline pipeline that you want to configure in the offline integration list on the right.
Click Property in the right sidebar of the current offline pipeline to open the Property panel.
In the Running Configuration section of the task Property panel, configure the running configuration information for the task.
Parameter
Description
Running Timeout
If the total running time of a single execution exceeds the set threshold and is still not completed, the task will be automatically terminated and marked as failed.
System Configuration: The system configuration is selected by default. The system configuration uses the Recurring Node parameter set in the tenant-level running configuration in the O&M module as the default value. For more information, see Running Configuration.
Custom: You can enter a number between 0 and 168 with up to 2 decimal places.
Auto Rerun Upon Timeout
Specifies whether to automatically rerun recurring instances or data backfill instances that are automatically terminated and marked as failed by the system after their running time exceeds the configured duration.
System Configuration: The system configuration is selected by default. Based on the tenant configuration in the O&M module, it can be set to not automatically rerun or to automatically rerun.
No Auto Rerun: When the current tenant has not enabled Auto Rerun upon Timeout in O&M > Global Configuration > Rerun Configuration, it displays as System Configuration: No Auto Rerun.
Auto Rerun: When the current tenant has enabled Auto Rerun upon Timeout in O&M > Global Configuration > Rerun Configuration, it displays as System Configuration: Auto Configuration.
Enable: If you select Enable, the configuration in O&M > Global Configuration > Rerun Configuration is ignored. When an instance times out, is terminated by the system, and is marked as failed, it will be automatically rerun.
Disable: If you select Disable, the configuration in O&M > Global Configuration > Rerun Configuration is ignored. When an instance times out, is terminated by the system, and is marked as failed, it will not be automatically rerun.
Auto Rerun Upon Failure
Determines whether to automatically rerun task instances or data backfill instances that fail to run based on the configuration.
System Configuration: The system configuration is selected by default. The system configuration uses the Auto Rerun upon Failure parameter set in the tenant-level running configuration in the O&M module as the default value. For more information, see: Running Configuration.
Custom: For rerun times, you can enter an integer between 0 and 10. For rerun interval, you can enter an integer between 1 and 60.
Click OK.