All Products
Search
Document Center

Dataphin:Configuring logical table data delay

Last Updated:Jan 21, 2025

Data delay for dimension and logical fact tables is designed to automatically rerun data within the Maximum Delay Days period. This topic explains the configuration process for data delay in dimension and logical fact tables.

Limits

  • The logical fact table must have daily data timeliness (offline T+1) and an event time field set to enable data delay configuration.

  • Delayed data processing is not supported if the current logical table lacks an event time field or a primary key.

Procedure

  1. Navigate to the Dataphin home page, select the top menu bar Development -> Data Development.

  2. Proceed as follows to access the Scan Configuration information page:

    Select Project (Dev-Prod mode requires environment selection) -> click the logical table -> choose the logical table task to schedule -> select Scan Configuration.

    image

  3. On the schedule configuration page, set the data delay for the logical table.

    Enable data delay, the system will automatically rerun all data within the maximum delay days period for this logical table. You can choose 1~15 days. As shown below:

    Note
    • Delayed data processing is not available if the logical table lacks an event time field, a primary key, or if custom materialization is enabled.

    • Enabling data delay will cause the system to rerun all data within the maximum delay days period for the logical table, which may increase computing resource usage and result in output delays.

    • Delayed data processing can only rerun the logical fact table automatically within the set period; it does not extend to downstream processes.

  4. Click Confirm to save the configuration.

What to do next

Once the logical table data delay is configured, proceed to set the scheduling properties of the logical table. For more information, see and the referenced document.