DataWorks:Dameng

Background information

Dameng (DM) is an Online Transactional Processing (OLTP) database that is integrated into business systems. It combines the advantages of distributed systems, elastic computing, and cloud computing. DM is flexible, easy to use, reliable, and highly secure. For more information, see the official Dameng (DM) website.

Prerequisites

• Create a Business Flow.

  DataStudio organizes development by Business Flows. You must create one before creating a node. For more information, see Create a workflow.

• A DM data source is created.

  You must add your DM database as a DataWorks data source to access its data. For more information about how to create a data source, see Data Source Management. For more information about how to use DM data sources in DataWorks, see DM (Dameng) data sources.

  Note

  DM nodes support only DM data sources that are created using a Java Database Connectivity (JDBC) connection string.

• The network connection between the data source and the resource group is established.

  Ensure that the data source can connect to the resource group that you want to use. For information about how to configure network connectivity, see Network connection solutions.

• (Optional; required for RAM users) Add the RAM user to the workspace and assign the Develop or Workspace Administrator role. Grant the Workspace Administrator role with caution due to its high privileges. For more information, see Add members to a workspace.

Limits

Supported regions: China (Hangzhou), China (Shanghai), China (Beijing), China (Shenzhen), China (Chengdu), China (Hong Kong), Singapore, Malaysia (Kuala Lumpur), Germany (Frankfurt), US (Silicon Valley), and US (Virginia).

Step 1: Create a DM node

1. Go to the DataStudio page.

   Log on to the DataWorks console. In the top navigation bar, select the desired region. In the left-side navigation pane, choose Data Development and O&M > Data Development. On the page that appears, select the desired workspace from the drop-down list and click Go to Data Development.

2. Right-click the target business flow and choose Create Node > Database > DM.

3. In the Create Node dialog box, specify a Name for the node and click Confirm. After the node is created, you can develop and configure the task in the node editor.

Step 2: Develop the DM task

(Optional) Select a DM data source

If multiple DM data sources are created in your workspace, select a data source on the node editor page. If only one DM data source is created, it is used by default.

Develop SQL code: Simple example

Write the task code in the code editor of the DM node. The following code provides an example.

SELECT * FROM usertablename;

Develop SQL code: Use scheduling parameters

DataWorks provides scheduling parameters that allow you to use dynamic parameters in your code for recurring schedules. In the node task, define variables in the ${variable_name} format. Then, in the Schedule section of the right-side navigation pane, go to Parameters and assign a value to the variable. For more information about the supported formats and how to configure scheduling parameters, see Formats of scheduling parameters and Configure and use scheduling parameters.

The following code provides an example.

SELECT '${var}'; -- You can use this with scheduling parameters.

Step 3: Configure task scheduling

To schedule the task, click Scheduling Configuration on the right and configure the properties. For more information, see Overview.

Step 4: Debug the task code

Debug the task to ensure correct execution:

1. (Optional) Select a debugging resource group and assign parameter values.

   • Click the icon in the toolbar. In the Parameters dialog box, select a resource group.

   • Assign values to any scheduling parameters for debugging. For more information about parameter assignment logic, see Task debugging process.

2. Save and run the task code.

   Click the icon to save, then click the icon to run.

3. (Optional) Run a smoke test.

   Run a smoke test during or after submission to verify execution in the development environment. For more information, see Perform smoke testing.

Step 5: Submit and publish the task

Submit and publish the node to activate the schedule.

1. Click the icon in the toolbar to save the node.

2. Click the icon in the toolbar to submit the node task.

   In the Submit dialog box, enter a Change Description and select code review options.

   Note

   • Configure the Rerun Property and Upstream Dependent Node before submitting.

   • Code review ensures quality. If enabled, a reviewer must approve the code before publication. For more information, see Code review.

In standard mode workspaces, click Publish in the upper-right corner to deploy to production. For more information, see Publish tasks.

What to do next

After a task is submitted and published, it is run on a recurring basis based on the node's configuration. You can click O&M in the upper-right corner of the node configuration tab to go to Operation Center. In Operation Center, you can view the scheduling and running status of the recurring task. For more information, see Manage recurring tasks.