DataWorks:Data push node

Background

The data push node retrieves output parameters from upstream SQL query nodes (like assignment nodes, Hologres SQL nodes, or ClickHouse SQL nodes) via Input and Output Parameters. You can embed these parameters as placeholders in your message content, then push to your chosen destination.

The process:

• Upstream SQL node completes and generates an outputs parameter containing query results.

• Data push node retrieves the outputs parameter via Input and Output Parameters and binds it as a node input parameter.

• Configure and send by referencing input parameters in your message, setting the destination, and pushing.

Supported upstream SQL nodes:

• Assignment node: Use this for MaxCompute SQL queries (Direct connections to MaxCompute SQL nodes aren't supported yet).

• Other SQL nodes: Hologres SQL node, ClickHouse SQL node, EMR Spark SQL nodes, EMR Hive node, MaxCompute Script node, AnalyticDB for PostgreSQL node, and MySQL node.

Prerequisites

• You have created a workspace.

• You have added a serverless resource group and bound it to your DataWorks workspace.

Limitations

• Size and rate Limits:

  Destination	Limit
  DingTalk	Max 20KB per message.
  Lark	Max 20KB per message; images must be under 10MB.
  WeCom	Max 20 messages per minute per bot.
  Teams	Max 28KB per message.
  Email	One email body per task; see the SMTP limits from your email provider for additional restrictions.

• Supported regions for data push:

  China (Hangzhou), China (Shanghai), China (Beijing), China (Shenzhen), China (Chengdu), China (Hong Kong), Singapore, US (Silicon Valley), US (Virginia).

Access Data Studio

1. Go to the Workspaces page in the DataWorks console. In the top navigation bar, select a desired region. Find the desired workspace and choose Shortcuts > Data Studio in the Actions column.

2. In the left navigation pane, click the icon.

Create your workflow

1. Create a scheduled workflow.

2. Configure the SQL query node and add your SQL query code.

   Note

   Data push nodes can't directly access ODPS SQL. To query MaxCompute data, create an assignment node instead.

3. Set up Scheduling on the right side of the node by selecting your Computing Resource, Resource Group, and selecting upstream nodes for Same-cycle Dependency (or choose Use Workspace Root Node if none exist). Configure output parameters:

   Node type	Configuration
   Assignment node	Output parameters are created automatically; no setup needed
   Other SQL nodes	Manually add output parameters: Go to Scheduling > Input and Output Parameters > Node Output Parameters then click Add Assignment Parameter.

4. Create a data push node and configure it as the downstream node.

   1. Click Scheduling, and in Scheduling Dependencies > Same-cycle Dependency, click Add and select your SQL query node as the upstream dependency.

   2. In Scheduling Policies > Resource Group, select the created serverless resource group.

   3. In Input and Output Parameters > Input Parameters, click Create Parameter. Bind the output parameter from the SQL node as the input parameter for the data push node.

Configure your push

Test

After configuring and saving both nodes, click the icon in the toolbar to test your data push task.

What to do next

• Node scheduling: To run nodes on a recurring schedule, configure the Scheduling policies in Scheduling.

• Node deployment: To run tasks in production, click the icon to start the deployment process. Nodes only execute on schedule after deploying to production.