All Products
Search
Document Center

Dataphin:Configure real-time template running parameters

Last Updated:Jan 21, 2025

Dataphin enables the configuration of running parameters within real-time templates. Tasks created from these templates will inherit the set parameters. This topic details the process for configuring running parameters in real-time templates.

Procedure

  1. Navigate to the Dataphin home page, and single click on the top menu bar Development > Data Development.

  2. On the Data Development page, use the operation guide shown in the figure below to select the desired real-time template, manage historical versions, and access the template version management page.

    image.png

  3. In the Configuration dialog box, set the running parameters.

    The default running parameters for real-time templates are as follows:

    Flink real-time computing engine

    execution.checkpointing.interval: '180s'
    execution.checkpointing.min-pause: '180s'
    table.exec.state.ttl: 36 h

    Ververica Flink real-time computing engine

    execution.checkpointing.externalized-checkpoint-retention: RETAIN_ON_CANCELLATION
    metrics.reporters: promappmgr
    metrics.reporter.promappmgr.port: '9999'
    metrics.reporter.promappmgr.class: org.apache.flink.metrics.prometheus.PrometheusReporter
    dataphin.vvp.v2: true
    execution.checkpointing.interval: '180s'
    execution.checkpointing.min-pause: '180s'
    table.exec.state.ttl: 36 h

    Explanation of Running Parameter Merge and Precedence:

    • By default, tasks derived from the template adopt the template's running configuration.

    • For a new job, the parameters combine: Default Task Running Parameters + Project Task Running Parameters.

    • For a new template, the parameters are a blend of: Default Task Running Parameters + Project Task Running Parameters.

    • Should the default and project task running parameters share a common parameter, the project's parameter value will take precedence and overwrite the default.

    • The running parameters for a new template task will be those of the template itself. Without any modifications to the template's parameters, the new template task's parameters will align with those of other new non-template tasks. Any changes to the template's parameters will apply to the new task.

    • Modifying template parameters affects template tasks as follows: existing parameter values remain unchanged, while new parameters are added.

  4. To finalize the configuration of running parameters, single click OK.