Data Management:Manage task flows and task flow instances

Go to the Task Orchestration Operation Center

1. Log in to DMS 5.0.

2. In the top navigation bar, choose O&M > Task Orchestration Operation Center.

   Note

   If you use the DMS console in simple mode, move the pointer over the icon in the upper-left corner of the DMS console and choose All Features > O&M > Task Orchestration Operation Center.

Task flow management

After you go to the Task Orchestration Operation Center, click Task Flow Management. You can then edit task flows, view directed acyclic graphs (DAGs), roll back versions, view the execution history of task flows (including execution time trend charts for task flows that are triggered by scheduling or manually triggered), publish or unpublish task flows in batches.

The Task Flow Management page lists task flows. The table includes columns such as Task Flow Name, Business Scenario, Scheduling Configuration, Description, Creation Time, Owner, and Actions (Edit, Publishing History, Execution History). You can filter the list by Business Scenario, Owner, and Publish Status.

Task flow instance management

After you go to the Task Orchestration Operation Center, click Instance Management. On this page, you can:

• In the Instance Statistics area, view the total number of executed task flow instances, including successful and failed runs.

  Note

  By default, these statistics are based on the execution time. To view statistics based on the business date, select the Business Date checkbox on the right.

• Filter task flow instances by status: Running, Success, or Fail.

• View the runtime status of a task flow.

• Click Execution History for a specific task flow to view its execution duration trend chart for both scheduled and manual executions.

Task flow scheduling statistics

After you go to the Task Orchestration Operation Center, you can select the runtime and one or more target task flows in the Scheduling Statistics area and use the Gantt chart to check whether the scheduling time is reasonable.

In the Gantt chart, task flow instances can have one of four statuses: Running, Paused, Fail, and Success. You can further filter the view by Group By and Concurrent Tasks, and use Reset Zoom to restore the default timeline view.

Control concurrent SQL queries

Use the Monitoring and Assurance feature to limit concurrent SQL queries from multiple task flows on a single database. This helps protect the stability, security, and reliability of your database.

1. Go to the Task Orchestration Operation Center.

2. Click Monitoring and Assurance. On the Concurrency Configuration tab, click Add Configuration.

3. Configure concurrency parameters such as Resource Type, Resource, and Resource Quota, and then click OK.

   For example, a resource quota of 20 allows a maximum of 20 task flows to run concurrently on the specified database.

   Note

   • A resource quota specifies the maximum number of task flows that can run concurrently on a database.

   • If the number of running task flows exceeds the quota, new task flows are placed in a priority queue to wait for execution.

   • The priority value ranges from 1 to 10. A higher value indicates a higher priority. If a task's wait time exceeds the maximum wait time configured for the task node, the task is removed from the queue and marked as failed.