DataWorks:Manually triggered workflow

Usage notes

• Manually triggered workflows cannot be automatically scheduled.

• The lines between nodes in a manually triggered workflow indicate only the execution sequence of the nodes, but do not indicate the configuration of scheduling dependencies between nodes.

• Manually triggered workflows are partially different from auto triggered workflows. For more information, see Feature description.

Design a manually triggered workflow

1. Go to the Workspaces page in the DataWorks console. In the top navigation bar, select a desired region. Find the desired workspace and choose Shortcuts > Data Studio in the Actions column.

2. In the left-side navigation pane of the Data Studio page, click the icon. In the Manually Triggered Workflows section of the MANUALLY TRIGGERED OBJECTS pane, click the icon on the right side and select Create Manually Triggered Workflow. In the popover that appears, specify a workflow name and press Enter. The configuration tab of the manually triggered workflow appears.

3. In the top toolbar of the configuration tab of the workflow, click Create Internal Node. In the popover that appears, select a required component type, enter a name, and then press Enter. The component appears in the canvas.

4. Design the workflow based on your business requirements.

   If a large number of nodes are created in a workflow, the workflow may not run properly. You can create a maximum of 200 nodes in a workflow, but we recommend that you create no more than 100 nodes in a workflow.

Design the business logic

DataWorks encapsulates the capabilities of different compute engines in different types of nodes. You can use nodes of different compute engine types to develop data, without the need to run complex commands on compute engines. You can also use the general nodes of DataWorks to design complex logic.

You can configure nodes in a workflow, such as nodes for Data Integration and computing nodes.

• You can edit a synchronization node to configure the source and destination to synchronize data from one database to another database.

• You can go to the configuration tab of a data development node, such as a MaxCompute SQL node, to cleanse data. If you want to use specific resources or functions when you develop code, DataWorks allows you to create resources and functions in a visualized manner. For more information about data development, see Node development. For more information about how to create a resource and function, see Resource management.

Deploy the manually triggered workflow

In a workspace in standard mode, the Data Studio page only allows you to develop and test nodes in the development environment. To deploy the node code to the production environment, you can deploy the workflow to which nodes belong to deploy the nodes in the workflow at a time.

1. Click Run in the top toolbar of the configuration tab of the manually triggered workflow and test whether nodes in the workflow can be successfully run on the running page of the workflow.

2. Click Return to Workflow in the top toolbar of the running page of the workflow to go back to the configuration tab of the workflow. Then, click Deploy in the top toolbar. On the DEPLOY tab, perform the following operations in sequence: building a deployment package, check before deployment to the development environment, deployment to the development environment, check before deployment to the production environment, and deployment to the production environment.

Run the manually triggered workflow in the production environment

1. After your manually triggered workflow is deployed, click Go to Operation Center to view the workflow in Operation Center.

   Note

   Alternatively, you can perform the following steps to view the manually triggered workflow in Operation Center: Go to the Workspaces page in the DataWorks console. In the top navigation bar, select a desired region. Find the desired workspace and choose Shortcuts > Operation Center in the Actions column. In the left-side navigation pane of the Operation Center page, click Manual Triggered Nodes.

2. On the page that appears, find the desired workflow task and click Run in the Actions column to run the manually triggered workflow.