A task flow is a directed acyclic graph (DAG) that consists of one or more tasks. When you use the Task Orchestration feature of Data Management (DMS), a task flow is the basic unit where data is analyzed. This topic describes how to create a task flow, create and connect task nodes in the task flow, and then configure the task flow.

Create a task flow

This section describes how to create a task flow.

  1. Log on to the DMS console.
  2. In the top navigation bar, choose Data Factory > Task Orchestration. The Home tab of the Task Orchestration page appears.
  3. In the Free orchestration tasks section, click New task flow.
  4. In the New Task Flow dialog box, set the Task Flow Name and Description parameters and click OK.
    New Task Flow dialog box

Create and connect task nodes in the task flow

This section describes how to create and connect task nodes in a task flow. You can create one or more tasks in the task flow.

  1. Log on to the DMS console.
  2. In the top navigation bar, choose Data Factory > Task Orchestration. The Home tab of the Task Orchestration page appears.
  3. On the left-side navigation submenu, click the Develop Space icon icon.
    Task Orchestration page
  4. In the left-side navigation pane, double-click the task flow that you created. The task orchestration tab of the task flow appears.
    Left-side navigation pane
  5. Drag a task node from the navigation tree to the blank area on the canvas. Repeat this step if you need to create more than one task node.
    Note For more information about supported task nodes and how to configure a task node, see Task.
    Drag a task node
  6. Optional. If you create multiple tasks in the task flow, you must connect the tasks in sequence based on your needs. Move the pointer over a task node on the canvas, click and hold the circle that appears in the middle of the bottom border, and then draw a line from the circle to another task node.
    Connect the task nodes
    This way, you can connect the multiple task nodes to form a task flow. The sequence of the task nodes is based on your business requirements. The following figure shows a sample task flow. In the task flow, the task a is the first task to be run and the task b is the second. After that, the tasks c and e are run at the same time.Sample task flow

Configure scheduling properties for the task flow

This section describes how to configure scheduling properties for a task flow. When you configure scheduling properties for a task flow, you can set the Scheduling cycle parameter as needed. Valid values are Hour, Day, Week, and Month.

  1. On the task orchestration tab of the task flow that you created, click the blank area on the canvas.
  2. Click the Scheduling tab on the right.
  3. On the Scheduling tab, set the parameters as described in the following table.
    Parameter Description
    Trigger type The scheduling type of the task flow. Valid values:
    • Cyclic scheduling
    • Schedule once
    Note If you select Schedule once, you only need to set the Specific Time parameter.
    Effective Time The time period during which the scheduling properties take effect. The default time period is from January 1, 1970 to January 1, 9999.
    Scheduling cycle The scheduling cycle of the task flow. Valid values: Hour, Day, Week, and Month.
    Specified Time The time when the task flow is run if you set the Scheduling cycle parameter to Hour, or the day on which the task flow is run if you set the Scheduling cycle parameter to Week or Month.
    Specific Time The specific point in time at which the task flow starts to be run. This parameter is displayed only if you set the Scheduling cycle parameter to Day, Week, or Month.
    Cron Expression The CRON expression that is automatically generated based on the scheduling cycle that you set.

    For example, you can schedule a task flow to be run at 05:00 every weekday, as shown in the following figure.

    Scheduling tab
  4. Click Save.

Configure basic properties for the task flow

This section describes how to configure basic properties for a task flow. The basic properties include the name, owner, and stakeholders of the task flow.

  1. On the task orchestration tab of the task flow that you created, click the blank area on the canvas.
  2. Click the Properties tab on the right.
  3. On the Properties tab, set the parameters as described in the following table.
    Properties tab
    Parameter Description
    Task Flow Name The name of the task flow.
    Owner The owner of the task flow. The owner can edit the task nodes and configurations of the task flow and run tests. The owner receives an alert if the task flow fails.
    Partner The one or more stakeholders of the task flow. The stakeholders can view, but not edit, the task nodes and configurations of the task flow. They can also run tests.
    Note DMS administrators and database administrators (DBAs) are the default stakeholders of each task flow that is created based on the Task Orchestration feature. They can also change the owners of task flows.
    Enable message notification Specifies whether to enable message notification for the task flow.
    Note To enable message notification for a task flow, make sure that a notification rule is configured for task flows that are created based on the Task Orchestration feature. Only DMS administrators and DBAs can configure notification rules. For more information, see Notification rule management.
  4. Click Save.

View the change history of the task flow

This section describes how to view the change history of a task flow.

  1. On the task orchestration tab of the task flow that you created, click the blank area on the canvas.
  2. Click the Operations tab on the right. The change history of the task flow is displayed on this tab.
    Operations tab

Configure variables for the task flow

This section describes how to configure variables for a task flow.

  1. On the task orchestration tab of the task flow that you created, click the blank area on the canvas.
  2. Click the Variables tab on the right.
  3. On the Variables tab, create one or more variables as needed. Set a name and a rule for each variable.
    Note For more information about the rules and usage of variables, see Task.
  4. Click Save.