Real-time mode defines runtime properties for a real-time node, including resource allocation, time parameters, and checkpoints.
Access the real-time mode configuration
-
On the Dataphin home page, choose R&D > Data Development from the top menu bar.
-
From the top menu bar, select a project. If you are in Dev-Prod mode, you must also select an environment.
-
In the left-side menu bar, choose Data Processing > Compute Task, and then select the target compute task from the list.
-
In the right sidebar, click Configuration. On the configuration panel, configure the parameters on the Real-time Mode tab.
Configure real-time mode
The following table describes the resource and dependency parameters on the real-time mode configuration panel.
|
Configuration item |
Description |
|
Resource configuration |
|
|
Variable configuration |
Configure variable parameters for a real-time computing node. For more information, see Real-time mode variable configuration. |
|
Checkpoint configuration |
Checkpoints save the task state to persistent storage, allowing you to restore the task to its pre-crash state after an unexpected failure. For more information, see Real-time mode checkpoint configuration. |
|
State configuration |
Flink State maintains and manages data state for real-time tasks. Configuring the time-to-live (TTL) for State data improves resource utilization, memory management, data consistency, and fault tolerance. For more information, see Real-time mode State configuration. |
|
Runtime Parameter |
Runtime parameters control node behavior and performance, such as JobManager memory size and TaskManager slot timeout. |
|
Dependency files |
Upload external resource files such as text files, Python files, or JAR files to Dataphin and add them as dependency files to ensure the node runs properly. For more information, see Configure dependency files in real-time mode. |
|
Dependency |
Dependencies define upstream and downstream relationships, helping you troubleshoot and test data flows. For more information, see Configure dependencies in real-time mode. |