The pipeline module contains the global configurations for Flink CDC data ingestion jobs.
Parameters
The following pipeline parameters apply only to the current Flink CDC data ingestion job.
|
Parameter |
Description |
Required |
Data type |
Default value |
Note |
|
|
The name of the Flink CDC data ingestion job. |
No |
STRING |
Flink CDC Pipeline Job |
- |
|
|
The strategy to handle schema changes. |
No |
STRING |
|
Valid values are listed below. For more information, see Schema evolution configurations.
|
|
|
The timeout period for SchemaOperator to wait for the completion of a downstream schema change event application. |
No |
DURATION |
3min |
- |
|
|
The local time zone for job execution. |
No |
STRING |
System time zone |
This setting affects time-related calculations in the |
|
|
The user-defined functions (UDFs) to register for the job. |
No |
LIST |
- |
For more information, see User-defined functions. |
|
transform.allow.trimming.pk-columns |
Allows transform rules to reduce upstream primary key constraints |
No |
BOOLEAN |
false |
Removing upstream PK constraints can cause multiple data entries to merge, potentially leading to data losses. Before using this setting, ensure the uniqueness of the new PK (if defined). |
|
transform.decimal.precision.mode |
Specifies the maximum Decimal precision used by the Transform module. |
No |
STRING |
UP_TO_19 |
Valid values:
Note
Supported only in VVR 11.7 and later. |