How to use the auto triggered task feature - Dataphin - Alibaba Cloud Documentation Center

An auto triggered task is automatically executed by the scheduling system based on its Scheduling Configuration. This topic describes the common features of integration, compute, and modeling tasks (logical dimension tables, logical fact tables, and logical aggregate tables), including usage instructions, supported scheduling types, and descriptions of related features.

Usage notes

The Operation Center supports the automatic scheduling of recurring instances only in the production environment. Although the Operation Center in the development environment also generates these instances, it does not support automatic scheduling for them.

Go to the Recurring Task page

In the top menu bar of the Dataphin homepage, choose Develop > Task O&M.
In the navigation pane on the left, choose Task O&M > Recurring Task.
In the top menu bar, select the production or development environment.

Recurring Task page

The Recurring Task page displays lists of Integration and Computing Tasks and Modeling Tasks. You can perform O&M operations on the corresponding tabs.

Block	Description
① Filter and search area	Filter: You can select My Tasks, Paused Tasks, or Dry-run Tasks, or select a Project to quickly filter tasks. The following filter options are also supported: My Tasks: Tasks that belong to the current logon account. Paused Tasks: Tasks in the current project whose scheduling property is set to Paused. Dry-run Tasks: Tasks in the current project whose scheduling property is set to Dry-run. Project: Filter tasks by the project to which they belong. You can select multiple projects for which the current logon user has O&M - Access Folder permissions. Task Type: For Data_disitll projects, you can select script tasks. For non-Data_disitll projects, you can select Integration and Computing Tasks and Modelling Task. Integration and Computing Tasks: The supported script tasks vary based on the compute engine. The actual options on the page prevail. Modelling Task: Logical dimension tables, logical fact tables, and logical aggregate tables. Scheduling Method: Filter by Normal, Dry-run, or Paused. For more information, see Scheduling method descriptions. Priority: Filter by instance running priority: Highest, High, Medium, Low, or Lowest. Note If the baseline feature is enabled, only Medium, Low, and Lowest priorities are supported. Operation Owner: Filter by the O&M owner of the auto triggered task. Recurrence: Filter by one of six scheduling cycles: Minute, Hour, Day, Week, Month, or Year. Update Time: Filter by a specific date or a date range when the auto triggered task was updated. Resource Group: Filter by the scheduling resource group configured for the auto triggered task. Note This filter option is supported only for integration and computing tasks. Tag: Select one or more task tag values to filter. To filter again, click Reset to quickly clear all filter conditions and restore the system defaults. Search: You can enter a single node ID or task object name for a fuzzy search. You can also click the icon in the search box to open the Batch Search dialog box. In the Batch Search dialog box, you can manually enter multiple task IDs or upload a file to search. You can use batch search together with other filter conditions. Batch Search - Manual Entry: In the Batch Search dialog box, select Manual Entry, enter up to 5000 task IDs separated by line breaks, and then click Confirm to search. Batch Search - Upload File: In the Batch Search dialog box, select File, and click Upload to upload an Excel file. The system automatically reads the first column (the task ID column) from rows 2 to 5001 of the first sheet in the Excel file. You can click Download Task ID List Template to edit and use the template.
② List operations	Customize table headers: Click the icon to select the items to display in the list and adjust their order. Note The first column and the Actions column cannot be hidden or reordered. If you clear the browser cache or switch to a different browser, the table headers are reset to their default settings. Refresh list: Click the icon to refresh the current list.
③ Recurring task list	The Recurring Task page lists all auto triggered tasks in projects for which the current user has O&M - Access Folder permissions. The tasks are divided into Integration and Computing Tasks and Modelling Task. The Actions column shows the supported O&M management operations for auto triggered tasks. The supported O&M operations for each type of auto triggered task are as follows: For the O&M operations supported in the integration and computing task list, see Supported operations in the integration and computing task list. For the O&M operations supported in the modeling task list, see Supported operations in the modeling task list. Note Only tasks of the current tenant are displayed in the auto triggered task list.
④ Batch operations area	You can use the batch operation features in the batch operations area to process auto triggered tasks in batches and improve operational efficiency. For the batch O&M operations supported for integration and computing tasks, see Supported batch operations for integration and computing tasks. For the batch O&M operations supported for modeling tasks, see Supported batch operations for modeling tasks.

Scheduling method descriptions

Icon	Scheduling Status	Description
None	Normal scheduling	Runs normally according to the configured scheduling cycle and start time.
	Dry-run	The task is scheduled according to the configured scheduling cycle, but it performs a dry-run. This means the task immediately returns a success status upon being scheduled, without actually running.
	Paused	Instances generated for a paused task have a Paused status. You can use the Resume operation to resume the instance. Pausing is useful when a task and its descendant nodes do not need to run temporarily but will be used again later. For example, you can pause a task to temporarily adjust calculation logic and prevent affecting output data. Details are as follows: After a task is paused, instances are still generated daily at midnight. All generated instances have a Paused status. Pausing a task is suitable for scenarios where a task node and its descendant nodes do not need to be scheduled for a period, but the task should not be unpublished. After you resume a task, its scheduling status changes from Paused to Normal. To run only some instances of a paused task, you can manually resume those specific instances to a Normal status.

Recurring task DAG

When you click a task object name in the auto triggered task list, a directed acyclic graph (DAG) appears on the right side of the page with the current node as the central node. The DAG provides a dynamic visualization of the upstream and downstream dependencies of the node. By default, it displays the Main node (the selected node) and its first-level upstream and downstream nodes. If an auto triggered task has no upstream or downstream nodes, the DAG shows only the current Main node. You can also perform O&M and management on the upstream and downstream nodes.

You can also adjust the display range of the DAG.

Click the icon to hide the real-time instance list and enlarge the DAG.
Click the icon to hide the DAG.
Hover over the icon and drag to expand or shrink the DAG area.

The following example uses a recurring script task:

Block	Description
① Node information	Displays summary information for the selected node. You can also click View Node Details to view more node information. Task Overview: Displays basic information about the current node, such as its name, ID, node type, tenant, project/data folder. Operation Logs: Displays the operation time, operator, and corresponding operation. Node Code/Materialization Code: Displays the code for the current node. You can view all versions of this node in the production environment. Click the icon to compare versions. Click the icon to view version information, including the version creation time and modifier. Task Parameters: Displays the parameters for the current node task. Integration and computing task nodes: Include Task Overview, Operation Logs, and Node Code. Modeling task nodes: Include Task Overview, Operation Logs, and Materialization Code. Real-time tasks: Include Node Details, Operation Logs, Node Code, and Task Parameters. External tenant nodes (nodes that do not belong to the current tenant): Display only the Task Overview.
② Node filter area	Quickly set the number of upstream and downstream layers to expand from the central Main node. If many nodes are expanded and difficult to view, you can search for a node ID or name to quickly locate a specific node within the current DAG view.
③ Scheduling dependency graph	Displays the scheduling dependency graph for the instance. You can expand more upstream and downstream nodes and perform O&M operations on them. Hover over a DAG node to view its name, type, scheduling type, O&M owner, and description. If a node has upstream or downstream nodes that do not belong to the current tenant, the external tenant nodes are marked with a cross-tenant tag. You can only expand their parent and child nodes. For the operations supported on integration and computing task DAG nodes, see Supported operations on integration and computing task DAG nodes. For the operations supported on modeling task DAG nodes, see Supported operations on modeling task DAG nodes.
④ Canvas adjustment area	Quickly adjust the DAG display scale. You can set a specific display scale (default is 100%), zoom in (up to 200%), zoom out (down to 20%), fit to canvas, and display in full screen. This area also displays the node ID and name of the Main node in the current DAG.