Dataphin:Overview of recurring task operations

Section

Description

① Filter and search area

• Filter: Select My Tasks, Paused Tasks, or Dry-run Scheduling Tasks for quick filtering. You can also filter by Project. The following filter items are also supported:

  • My Tasks: Tasks that belong to the current logon account.

  • Paused Tasks: Tasks in the current project whose scheduling property is set to pause scheduling.

  • Dry-run Scheduling Tasks: Tasks in the current project whose scheduling property is set to dry-run.

  • Project: Filter by project. You can select multiple projects for which the current logon user has Operations - Access directory permissions.

  • Task Type: Data_disitll projects support script tasks. Non-Data_disitll projects support Integration And Computing Tasks and Modeling Task.

    • Integration And Computing Tasks: The supported script tasks vary by compute engine. The actual options are displayed on the page.

    • Modeling Task: Includes logical dimension tables, logical fact tables, and logical aggregate tables.

  • Scheduling Mode: Filter by normal scheduling, dry-run scheduling, or paused scheduling. For more information, see Scheduling mode description.

  • Priority: Filter by instance run priority. Options are Highest, High, Medium, Low, and Lowest.

    Note

    If the baseline feature is enabled, only Medium, Low, and Lowest task priorities are supported.

  • Operation Owner: Filter by the owner of the recurring task.

  • Recurrence: Filter by scheduling cycle. Options are Minute, Hour, Day, Week, Month, and Year.

  • Update Time: Filter by the date or date range when the recurring tasks were updated.

  • Resource Group: Filter by the scheduling resource group configured for the recurring tasks.

    Note

    This filter is supported only for integration and computing tasks.

  • Tag: Select one or more tag values to filter tasks.

  To filter again, click Reset to clear all filter conditions and restore the defaults.

• Search: Enter a single node ID or task object name for a fuzzy search. You can also click the icon in the search box to open the Batch Search dialog box. In the Batch Search dialog box, you can manually enter multiple task IDs or upload a file to search. Batch search can be combined with other filter conditions.

  • Batch search - Manual input: In the Batch Search dialog box, select Manual input. Enter up to 5000 task IDs, separated by line breaks. After entering the IDs, click Confirm to start the search.

  • Batch Search - Upload Document: In the Batch Search dialog box, select Upload Document and click Upload to upload an Excel file. The system automatically reads the first column (the Task ID column) and rows 2 to 5001 from the first sheet of the file. You can click Download Task ID List Template to download the template.

② List operations

• Customize list header: Click the icon to select the items to display in the list and adjust their order.

  Note

  • The first and Actions columns cannot be hidden or reordered.

  • The header settings are reset to default if you clear the browser cache or switch to a different browser.

• Refresh list: Click the icon to refresh the current list.

③ Recurring task list area

The recurring task page lists all recurring tasks in projects for which the current user has Operations - Access directory permissions. The tasks are categorized into Integration And Computing Tasks and Modeling Task. The Actions column shows the supported operations for each task. For details about the supported operations for each task type, see the following documents:

• For more information about operations supported in the integration and computing task list, see Operations supported in the integration and computing task list.

• For more information about operations supported in the modeling task list, see Operations supported in the modeling task list.

④ Batch operations area

Use the features in the batch operations area to process recurring tasks in batches and improve efficiency.

• For more information about batch operations supported for integration and computing tasks, see Batch operations supported for integration and computing tasks.

• For more information about batch operations supported for modeling tasks, see Batch operations supported for modeling tasks.

Icon

Scheduling status

Description

None

Normal scheduling

The task runs normally according to the configured scheduling cycle and start time.

Dry-run scheduling

The task is scheduled according to the time configuration, but it runs in dry-run mode. This means the task immediately returns a success status without actually running.

Pause scheduling

Instances generated for tasks with paused scheduling are in the Paused state. Use the Resume operation to resume the instances. Pausing is suitable for scenarios where some tasks and their downstream nodes do not need to run temporarily but will be used later. For example, you can temporarily adjust calculation logic to prevent affecting downstream data.

Note the following details:

• After a task is paused, instances are generated normally at midnight every day. All generated instances are in the Paused state. Pausing a task is suitable for scenarios where the task node and its downstream nodes do not need to be scheduled, but the task does not need to be unpublished.

• After a task is resumed, its scheduling mode changes from paused scheduling to normal scheduling. For a paused task, if some instances need to run, you can manually restore the instances to the normal scheduling state.

Section

Description

① Node information

Displays a summary of the selected node. Click View Node Details to see more information.

• Task overview: Displays basic information about the node, such as its name, ID, type, and project or data domain.

• Operation logs: Displays the time, operator, and operation.

• Node code/Materialization code: Displays the node's code. You can view all versions of the node in the production environment. Click the icon to compare versions. Click the icon to view version information, including the creation time and the user who made the modification.

• Task parameters: Displays the parameters for the node task.

Integration and computing task nodes: Include task overview, operation logs, and node code.

Modeling task nodes: Include task overview, operation logs, and materialization code.

Real-time tasks: Include node details, operation logs, node code, and task parameters.

② Node filter area

Quickly set the number of upstream and downstream levels to expand from the main node. If many nodes are expanded, search for a node ID or name to quickly locate a specific node within the current DAG view.

③ Scheduling dependency graph

Displays the scheduling dependency graph for the instance. You can expand more upstream and downstream nodes and perform operations on them. Hover your mouse over a node in the DAG to view its name, type, scheduling type, owner, and description.

• For more information about operations supported for DAG nodes of integration and computing tasks, see Operations supported for DAG nodes of integration and computing tasks.

• For more information about operations supported for DAG nodes of modeling tasks, see Operations supported for DAG nodes of modeling tasks.

④ Canvas adjustment area

Quickly adjust the DAG display scale. You can set a specific scale (default is 100%), zoom in (up to 200%), zoom out (down to 20%), fit to canvas, or display in full screen. This area also shows the node ID and name of the main node in the current DAG.