Data Management:Variables

Overview

• Node variables are time variables that can be used only on the current node.
• Task flow variables are time variables that can be used on all nodes of the current task flow.
  Note You can configure task flow variables on one of the task nodes in a task flow. Then, the configuration of task flow variables is synchronized to other task nodes in the task flow.
• Input variables are automatically obtained by Data Management (DMS). You can use ${var_name} to reference an input variable in SQL statements for the current node. You can also use an input variable as a filter condition for a Conditional Branch node. The following variables are considered as input variables:
  • Upstream variables are output variables from upstream nodes.
  • Status variables: For more information, see the Status variables section of this topic.
  • System variables: For more information, see the System variables section of this topic.
• Output variables are defined and have their values assigned on the current node. Output variables can be accessed and referenced by downstream nodes.

  For example, if you configure an output variable on a Script node, the output variable can be referenced in the SQL statements of a downstream node.

• Script output variables: If the last line of the script file is a JSON string in the format of { key1: value1, key2: value2, … } for a Script node, the script task parses the key-value pairs in the JSON string to obtain output variables. For each variable, the name is a key and the value is the value of the key. You can reference a script output variable in the format of ${key} in the SQL statements of a downstream node.

  For example, if the last line of the script file is echo {"hello": "world"}, the script task parses the key-value pair to obtain an output variable whose name is hello and value is world.

Configure time variables

Parameter	Description
Variable Name	The name of the custom time variable. Note To delete a time variable that you configured, click the icon to the right of the Variable Name field.
Variable Rule	The time format and time offset configurations of the custom time variable. Time Format: the time format of the time variable. For more information, see the Time formats section of this topic. Time offset: Time variables are offset from the data timestamp, which is one day before the current date. In other words, the value of a custom time variable indicates the date to which the specified time offset points based on the data timestamp. For example, you have created a variable named 6_month_ago in the yyyy-MM-dd format and set the offset to "- 6 Month". In this case, if the current date is August 12, 2021, the value of the ${6_month_ago} variable is 2021-02-11, which indicates February 11, 2021. Note After you configure a time variable, you can reference the variable in the ${var_name} format in SQL statements for the current node. You can also click SQLPreview to view the value of the time variable.

Time formats

The following table describes the time variables that can be used to define the time format of a custom variable.

The following table describes the sample time formats that use multiple time variables.

Status variables

System variables