Dataphin:Periodic task O&M

Section

Description

① Filter and search area

• Filter: You can quickly filter tasks by selecting My Tasks, Suspended Tasks, Dry-run Tasks, or by selecting a Project. The following filter options are also supported:

  • My Tasks: Tasks owned by the current user.

  • Suspended Tasks: Tasks in the current project with the suspended scheduling mode.

  • Dry-run Tasks: Tasks in the current project with the dry-run scheduling mode.

  • Project: Filter tasks by project. You can select multiple projects for which the current user has O&M-Access Directory permissions.

  • Task Type: For Data_disitll projects, you can select script tasks. For non-Data_disitll projects, you can select Integration and Computing Tasks and Modeling Tasks.

    • Integration and Computing Tasks: The supported script tasks vary by compute engine. The options displayed on the page prevail.

    • Modeling Tasks: dimension logic table, fact logic table, and aggregate logic table.

  • Scheduling Mode: Filter by normal scheduling, dry-run scheduling, or suspended scheduling. For more information, see Scheduling modes.

  • Priority: Filter by the running priority of instances: Highest, High, Medium, Low, or Lowest.

    Note

    If the baseline feature is enabled, only Medium, Low, and Lowest priorities are supported.

  • O&M Engineer: Filter periodic tasks by their O&M engineer.

  • Scheduling Cycle: Filter by one of six scheduling cycles: Minute, Hour, Day, Week, Month, or Year.

  • Update Time: Filter by a specific date or date range when the periodic task was last updated.

  • Scheduling Resource Group: Filter by the scheduling resource group configured for the periodic task.

    Note

    This filter is supported only for Integration and Computing Tasks.

  • Tag: Filter by one or more task tag values.

  • Directory: Filter by the directory where integration tasks, computing tasks, data aggregation, or workflow tasks are located within the selected project.

    Note

    Filtering by detailed directory is supported only for Integration and Computing Tasks.

  To filter again, click Reset to quickly clear all filter conditions and restore the system defaults.

• Search: You can enter a single node ID or task name for a fuzzy search. You can also click the icon in the search box to open the Batch Search dialog box. In the Batch Search dialog box, you can manually enter multiple task IDs or upload a file to search. A batch search can be combined with other filter conditions.

  • Batch Search - Manual Input: In the Batch Search dialog box, select Manual Input, enter up to 5,000 task IDs (one ID per line), and then click Confirm to search.

  • Batch Search - Upload File: In the Batch Search dialog box, select Upload File and click Upload to upload an Excel file. The system automatically reads rows 2 to 5,001 of the first column (the task ID column) in the first sheet of the Excel file. You can click Download Task ID List Template to download and use a template.

② List operations

• Customize Columns: Click the icon to select the columns to display and reorder them.

  Note

  • The first column and the Actions column cannot be hidden or reordered.

  • If you clear your browser cache or use a different browser, the column settings revert to the default.

• Refresh: Click the icon to refresh the current list.

• Batch Operation Records: Click Batch Operation Records to view the execution details of batch operations for periodic tasks in the Batch Operation Records panel. This includes the task name, task ID, operation type, operation time, and status. You can filter by operation type and status, or search by task name or task ID. For failed operations, you can hover over the prompt icon next to the status to view the failure reason.

③ Periodic task list area

The periodic task page lists all tasks in projects where the current user has O&M-Access Directory permissions. The list is divided into Integration and Computing Tasks and Modeling Tasks. The Actions column shows the available O&M operations for each task. You can resize the columns as needed. The browser saves your column width settings. Clearing your browser's history and cookies will reset them. The supported O&M operations for each task type are as follows:

• For O&M operations supported by the Integration and Computing Tasks list, see Supported operations for the Integration and Computing Tasks list.

• For O&M operations supported by the Modeling Tasks list, see Supported operations for the Modeling Tasks list.

④ Batch operation area

Use the batch operation features in this section to manage multiple periodic tasks at once.

• For batch O&M operations supported for integration and computing tasks, see Supported batch operations for integration and computing tasks.

• For batch O&M operations supported for modeling tasks, see Supported batch operations for modeling tasks.

Icon

Scheduling status

Description

None

Normal scheduling

Runs normally based on the configured scheduling cycle and start time.

Dry-run scheduling

The task is triggered at its scheduled time but only performs a dry run. It immediately returns a success status without executing.

Suspended scheduling

Instances of a suspended task are generated in a paused state. You can use the Resume action to run an instance. Suspending is useful for temporarily disabling a task and its downstream dependencies without taking them offline, for example, to temporarily adjust calculation logic to avoid affecting downstream data.

Details are as follows:

• After a task is suspended, instances are still generated normally (at 00:00 every day), but they are created in a paused state. This is useful when a task node and its downstream nodes must be temporarily inactive but not taken offline.

• When you resume a task, its scheduling property changes from suspended scheduling to normal scheduling. To run only specific instances of a suspended task, you can resume them individually.

Section

Description

① Node information

Displays a summary of the currently selected node. You can click View Node Details to see more information.

• Task Overview: Displays basic information about the current node, such as its name, ID, node type, tenant, project, and data domain.

• Operation Log: Shows the operation time, the operator, and the corresponding operation.

• Node Code/Materialized Code: Displays the code for the current node. You can view all versions of this node in the production environment. Click the icon to compare versions. Click the icon to view version information, including its creation time and the modifying user.

• Task Parameters: Displays the parameters for the current node's task.

Integration and computing task nodes: Include Task Overview, Operation Log, and Node Code.

Modeling task nodes: Include Task Overview, Operation Log, and Materialized Code.

Real-time tasks: Include Node Details, Operation Log, Node Code, and Task Parameters.

Cross-tenant nodes (nodes not belonging to the current tenant): Show only the Task Overview.

② Node filter area

You can quickly set the number of upstream and downstream levels to expand from the main node. If too many nodes are expanded and the view becomes hard to read, you can search for a node ID or name to quickly locate a node within the current DAG view.

③ Scheduling dependency graph

Displays the scheduling dependency graph for the instance. You can expand more upstream and downstream nodes and perform O&M operations on them. Hover over a node in the DAG to view its name, type, scheduling type, O&M engineer, and description. If a node has dependencies in another tenant, the external node is marked with a cross-tenant tag, and you can only expand its parent and child nodes.

• For operations supported on DAG nodes for integration and computing tasks, see Supported operations for DAG nodes of integration and computing tasks.

• For operations supported on DAG nodes for modeling tasks, see Supported operations for DAG nodes of modeling tasks.

④ Canvas adjustment area

You can quickly adjust the display scale of the DAG. Options include setting a specific scale (default is 100%), zooming in (up to 200%), zooming out (down to 20%), fitting to the canvas, and full-screen display. This area also shows the node ID and name of the main node in the current DAG.