Task failure rerun and priority

Updated at:
Copy as MD

Before running a task, you can set the execution priority for its database. When the number of concurrent tasks on a database exceeds the configured quota, Data Management (DMS) places new tasks in a priority queue and runs them based on their priority level. Tasks with a higher priority are run first. You can also enable the task rerun feature to automatically rerun a task that fails.

Task execution priority

Note

Task priority applies only to queued tasks.

  1. Set the quota for concurrent tasks. If the number of concurrent tasks on a database exceeds this quota, DMS places new tasks in a priority queue. Otherwise, DMS runs tasks immediately.

    1. Go to the Task Orchestration Operation Center.

    2. Click Monitoring and Assurance. On the Concurrency Configuration tab, click Add Configuration.

    3. Configure concurrency parameters such as Resource Type, Resource, and Resource Quota, and then click OK.

      For example, a resource quota of 20 allows a maximum of 20 task flows to run concurrently on the specified database.

      Note
      • A resource quota specifies the maximum number of task flows that can run concurrently on a database.

      • If the number of running task flows exceeds the quota, new task flows are placed in a priority queue to wait for execution.

      • The priority value ranges from 1 to 10. A higher value indicates a higher priority. If a task's wait time exceeds the maximum wait time configured for the task node, the task is removed from the queue and marked as failed.

  2. On the Task Flow Management page, click the name of the target task flow to go to the task flow details page.

  3. Double-click a task node to open its node configuration page.

  4. In the right-side pane, click Advanced Settings, and then turn on the Enable Priority switch.

  5. Configure the Task Priority (from 1 to 10) and Longest Lock Wait Duration based on your business requirements.

    Note

    The priority level ranges from 1 to 10, where 10 is the highest priority. If a task waits in the queue longer than the maximum wait time configured for the task node, it is removed from the queue and marked as failed.

Task node reruns

  1. On the Task Flow Management page, click the name of the target task flow to go to the task flow details page.

  2. Double-click a task node to open its node configuration page.

  3. In the right-side pane, click Advanced Settings, and then turn on the Enable re-run of failed task switch (disabled by default).

  4. Configure the Maximum Rerun Times (from 1 to 100) and Rerun Interval (from 1 to 1,800 seconds) based on your business requirements.

    Note

    If the task still fails after all rerun attempts, you must start it manually.