Backfill Scheduled Tasks to Recover Historical Pipeline Data - Dataphin - Alibaba Cloud - Dataphin

Scheduled backfill tasks automatically generate and run backfill instances on a configured schedule to backfill historical data. You can view task details, edit configurations, and perform batch operations from the Backfill Task page.

Access scheduled backfill tasks

In the top navigation bar of the Dataphin homepage, choose Develop > Task O&M.
In the navigation pane on the left, choose Task O&M > Backfill Task.
In the top navigation bar, select the production or development environment.
On the Backfill Task page, click the Scheduled tab.

The Scheduled tab

The Scheduled tab lists all scheduled backfill tasks and provides filtering, search, and batch management options.

Section	Description
① Filter and search area	You can search and filter backfill tasks in this area. Search: Search for backfill tasks by name. Filter: Filter tasks by project, or click Filter to expand more filter options. Project: Filter by project. You can select multiple projects if you have the O&M - Access Directory permission. Scheduling Cycle: Filter by scheduling cycle. Options include Daily, Weekly, and Monthly. Owner: Filter by owner. Scheduled Run: Filter by the effective status of the backfill task. Scheduling Resource Group: Filter by scheduling resource group. Click Reset to clear all filter conditions and restore the default settings.
② List operations	Create Backfill Task: Click + Create Backfill Task to create a backfill task. For more information, see Create a backfill task. Customize Columns: Click the icon to select the columns to display and adjust their order. Note The first column and the Actions column cannot be hidden or reordered. If you clear your browser cache or switch browsers, the column header settings revert to the default. Refresh: Click the icon to refresh the list.
③ Backfill task list	The backfill task list shows details such as Backfill task name, Schedule period, Scheduled time (in the scheduling time zone), Business date, Last updated by/time, Owner, Status, Project, and Scheduling resource group. You can adjust column widths. These settings are saved in your browser and reset if you clear its history and cookies. Note A backfill instance for a scheduled backfill task is generated before 23:00 on the day before its scheduled run. Click the icon for the effective status to enable or disable the backfill task. When enabled, the task runs according to its configuration. When disabled, the task does not run. Regarding the scheduling resource group: If a specified custom resource group is unavailable, the system uses the project default resource group. If that is also unavailable, it falls back to the tenant default resource group. If you change a project's default resource group, the scheduling resource group column may not update immediately, but subsequent task runs will use the new resource group. The backfill task list supports the following operations: Manual Run: Click the icon to run the task manually. Edit: Modify the task's configuration. Note Dataphin automatically expands the backfill nodes based on the configuration. When you edit an existing backfill task, the configuration shows the original settings merged with the latest information from the backfill nodes. Transfer Owner: Transfer ownership of the task. Delete: Delete the backfill task.
④ Batch operations area	Select multiple backfill tasks to perform the following batch operations: Enable: Enables multiple scheduled backfill tasks at once. Disable: Disables multiple scheduled backfill tasks at once. Transfer Owner: Transfers ownership of multiple tasks at once. Delete: Deletes multiple backfill tasks at once.