All Products
Search
Document Center

Data Management:Getting started

Last Updated:Dec 14, 2023

This topic describes how to create, configure, run, and publish a task flow.

Flowchart of developing a task flow

image.png

Procedure

Step 1: Create a task flow

  1. Log on to the DMS console V5.0.
  2. In the top navigation bar, click DTS > Data Development > Task Orchestration.

    Note

    If you use the DMS console in simple mode, move the pointer over the 2022-10-21_15-25-22.png icon in the upper-left corner of the DMS console and choose All functions > DTS > Data Development > Task Orchestration.

  3. Click Create Task Flow. In the Create Task Flow dialog box, configure the Business Scenario and Task Flow Name parameters, and click OK.

Step 2: Add task nodes

  1. Add task nodes on the directed acyclic graph (DAG) of the task flow.

    In the Task Type list on the left side of the DAG, drag the task nodes that you want to add to the blank area on the DAG.

  2. Configure the task nodes.

    Double-click the task node that you want to manage. On the page that appears, configure the task node.

  3. Connect the task nodes.

    If multiple task nodes exist on the DAG and logical relationships exist among the task nodes, you need to connect the task nodes to form a task flow.

    To do so, move the pointer over the upstream node, click the hollow circle that appears on the right side of the task node, and then drag the connection line to the downstream node. The following figure shows the connection between two task nodes.

Step 3: Configure the task flow

In the lower part of the task flow page, click the image.png icon and configure the parameters on different tabs based on your business requirements.

In this example, default values are used for parameters on the Variable Configuration and Notification Configurations tabs.

  • On the Task Flow Information tab, configure the parameters such as Task Flow Name, Owner, and Stakeholders. The following table describes some of the parameters.

    Parameter

    Description

    Owner

    The owner of the task flow. The owner can modify the task nodes and configurations of the task flow and perform test runs. The owner can also receive an alert if the task flow fails.

    Note

    If you change the owner of a task flow, you must republish the task flow to make the modification take effect.

    Stakeholders

    The stakeholders of the task flow. A stakeholder of a task flow can view the task flow and task configurations, and perform test runs on tasks. However, the stakeholder does not have permissions to modify the task flow and task configurations.

    Note

    Data Management (DMS) administrators and database administrators (DBAs) are the default stakeholders of each task flow. They can also change the owners of task flows.

    Error Handling Policy

    The action to take when an error occurs for the first time during the execution of a task flow. Valid values:

    • Complete Running Tasks: If an error occurs, tasks that are running continue to run until the tasks are complete. Other tasks are not run. After the task flow is complete, it is marked as a failed task flow.

    • Immediately Stop All Tasks: If an error occurs, all tasks in the task flow are stopped.

    • Complete Unrelated Tasks: If an error occurs in a task node, tasks that are running continue to run. Subsequent tasks that are not related to the failed task node are also run.

    Concurrency Control Policy

    The execution policy that is available when one of the two task flows is already running and you run the task flows again. Valid values:

    • Skip: The system skips the task flow.

    • Ignore: The system runs the task flow. Make sure that the previous execution of the task flow is not affected.

    • Run in Parallel: The system concurrently runs the two task flows.

      • Mode 1: The system suspends Task A until Task A of the previous task flow is complete.

      • Mode 2: The system suspends Task A until Task A and its downstream tasks in the previous task flow are complete.

    Set task flow to public

    Specifies whether to set the task flow to public. If you set the task flow to public, all the users of the tenant can view the task flow, but they cannot modify or run the task flow. The owner can modify and run the task flow. The task flow is not included in the statistics of task flows in different states on the dashboard unless you are the owner of the task flow.

  • In the Scheduling Settings section of the Task Flow Information tab, turn on Enable Scheduling and configure a scheduling policy.

    In this example, a scheduling policy that meets the following requirement is created: The task flow is scheduled at 00:00 every Monday and Thursday from August 3, 2023 to August 31, 2023.

    image.png

Step 4: Run the task flow

After the task flow is configured, click Try Run. Then, the tasks in the task flow are executed in sequence.

You can also run a task flow in the Dry Run, Run at a Specific Point in Time, or Run at a Specific Time Range mode. For more information about the runtime modes of a task flow, see Terms.

Step 5: Publish a task flow

Make sure that the task flow is correctly configured before you click Publish.

After the task flow is published, you can click Go to O&M in the upper-right corner of the task flow page. In the Task Flow Information section, you can view the configuration information, such as the creator and scheduling policy of the task flow.