You can use a workflow to organize nodes based on business types. This way, you can develop code by business. This topic describes how to create, design, commit, and view a workflow and how to modify or delete multiple nodes in a workflow at the same time.

Background information

A workspace supports various types of compute engines and can contain multiple workflows. A workflow is a collection of multiple types of objects. The object types include Data Integration, Data Analytics, table, resource, function, and algorithm.

Each type of object corresponds to an independent folder. You can create subfolders in the folder. To facilitate the management of objects, we recommend that you create no more than four levels of subfolders. If you create more than four levels of subfolders, your workflow becomes excessively complex. In this case, we recommend that you split your workflow into two or more workflows and add the workflows to the same solution to improve work efficiency.

Create a workflow

  1. Go to the DataStudio page.
    1. Log on to the DataWorks console.
    2. In the left-side navigation pane, click Workspaces.
    3. In the top navigation bar, select the region where your workspace resides, find the workspace, and then click Data Analytics in the Actions column.
  2. Move the pointer over the Create icon and click Workflow.
    Workflow
  3. In the Create Workflow dialog box, set the Workflow Name and Description parameters.
    Notice The workflow name must be 1 to 128 characters in length and can contain letters, digits, underscores (_), and periods (.).
  4. Click Create.

Design a workflow

Note We recommend that you create no more than 100 nodes in a workflow.
A workflow can contain the following types of nodes. You can design a workflow based on your business requirements.

Commit a workflow

  1. After you design a workflow, click the Submit icon in the toolbar.
  2. In the Commit dialog box, select the nodes that you want to commit and enter your comments in the Change description field. Then, determine whether to select Ignore I/O Inconsistency Alerts based on your business requirements. If you do not select Ignore I/O Inconsistency Alerts, an error message is displayed after the system detects that your input and output content does not match the code lineage. For more information, see When I commit a node, the system reports an error that the input and output of the node are not consistent with the data lineage in the code developed for the node. What do I do?.
    Commit
  3. Click Commit.
    Note If you have modified the code or properties of a node and committed the node on its configuration tab, you cannot select the node in the Commit dialog box. If you have modified the code or properties of a node but have not committed the node on its configuration tab, you can select the node in the Commit dialog box.

View all workflows

In the Data Analytics pane, right-click Business Flow and select All Workflows to view all the workflows in the current workspace. All workflows
Click the card of a workflow. The dashboard of the workflow appears. View workflows

Modify or delete multiple nodes at the same time

If you want to modify or delete multiple nodes of the same type, such as all batch synchronization nodes, in the current workspace at the same time, you can use the parameters on the Nodes tab to find the nodes and modify or delete the nodes. The parameters include Node type, Business process, and Scheduling Resource Group.
Note You can modify only the owners and scheduling resource groups of multiple nodes at the same time.
  1. In the Data Analytics pane, click the Nodes icon on the right side of Business Flow to go to the Nodes tab.
  2. Modify or delete nodes. Modify or delete nodes
    1. Use parameters such as Node name/ID, Node type, and Business process to find the nodes that you want to modify or delete.
    2. Select some or all nodes.
    3. Modify or delete the nodes.
      • To modify the selected nodes, click Modify owner or Modify Scheduling Resource Group. You can modify only the owners and scheduling resource groups of multiple nodes at the same time.

        If you set the Force modification parameter to Yes in the dialog box that appears, you can modify all the selected nodes. If you set this parameter to No, you can modify only the nodes that are locked by yourself.

      • To delete the selected nodes, choose More > Delete in the lower part of the Nodes tab.

        If you set the Force delete parameter to Yes in the Delete node dialog box, you can delete all the selected nodes. If you set this parameter to No, you can delete only the nodes that are locked by yourself.

How do I export multiple workflows from a DataWorks workspace at a time and import them to other workspaces of DataWorks or to other open source engines?

If you want to export multiple workflows in a workspace from DataWorks at a time and import them to other workspaces of DataWorks or to other open source engines, you can use the Migration Assistant service of DataWorks. For more information, see Overview.