This topic describes how to create a workflow, create nodes in the workflow, and configure the dependencies. After you create a workflow, you can use the DataStudio service to further compute and analyze data in the workspace.
Create a workflow
- Log on to the DataWorks console.
- In the left-side navigation pane, click Workspaces.
- After you select the region where the required workspace resides, find the workspace and click Data Analytics.
- On the Data Analytics tab, move the pointer over the icon and select Workflow.
- In the Create Workflow dialog box, set the Workflow Name and Description parameters.Notice The workflow name must be 1 to 128 characters in length. It can contain letters, digits, underscores (_), and periods (.).
- Click Create.
Create nodes and configure dependencies
- A zero load node is a control node that is used to maintain and control its descendant nodes in a workflow. A zero load node does not affect data.
- If other nodes depend on a zero load node and the zero load node is set to Failed by an administration expert, the pending descendant nodes cannot be triggered. During the O&M process, a zero load node can be disabled to prevent errors of ancestor nodes from being further expanded.
- Typically, the root node of the workspace is used as the ancestor node of a zero load
node in a workflow. The root node of a workspace is named in the
- DataWorks automatically creates an output name for a node, in the Workspace name. Node name format. If a workspace contains two nodes with the same name, modify the output name of one of the nodes.
When you design a workflow, we recommend that you create a zero load node as the root node of the workflow to control the entire workflow. To design a workflow, perform the following steps:
- Double-click the name of a workflow to go to the configuration tab. Click Zero-Load Node and drag it to the canvas on the right.
- In the Create Node dialog box, set the Node Name parameter to start and click Commit.Notice The node name must be 1 to 128 characters in length. It can contain letters, digits, underscores (_), and periods (.).
- Use the same method to create an ODPS SQL node named insert_data.
- Drag a line to configure the start node as the parent node of the insert_data node.
Configure the parent node of the zero load node
In a workflow, a zero load node is often used to control the entire workflow and serves as the ancestor node of all nodes in the workflow.
Generally, a zero load node depends on the root node of the workspace.
- Double-click the name of the zero load node to go to the node configuration tab.
- Click Properties in the right-side navigation pane.
- In the Dependencies section, click Use Root Node to configure the root node of the workspace as the parent node of the zero load node.
- Click the icon in the toolbar.
Edit and run the ODPS SQL node
This section uses SQL code to query and save the number of singles with different education levels who loan to buy houses in the ODPS SQL node insert_data. The descendant nodes can continue to analyze and present the results.
- Go to the configuration tab of the ODPS SQL node and enter the following code.For more information about the syntax, see MaxCompute SQL overview.
INSERT OVERWRITE TABLE result_table -- Insert data to the result_table table. SELECT education , COUNT(marital) AS num FROM bank_data WHERE housing = 'yes' AND marital = 'single' GROUP BY education
- Right-click bank_data in the code and select Delete Input.
- Click the icon in the top toolbar. This prevents code loss.
- Click the icon.After the node is run, you can view the operational log and result in the lower part of the tab.
Commit the workflow
- After you run and debug the ODPS SQL node insert_data, return to the configuration tab of the workflow.
- Click the icon.
- In the Commit dialog box, select the nodes to be committed, enter your comments in the Change description field, and then select Ignore I/O Inconsistency Alerts.
- Click Commit.
What to do next
Now you have learned how to create and commit a workflow. You can proceed with the next tutorial. In the next tutorial, you will learn how to create a sync node to export data to different types of data stores. For more information, see Create a sync node.