This release is based on Ververica Runtime (VVR) 6.0.4 of Apache Flink 1.15.2. The main updates include expanded Hologres connector capabilities, MySQL Change Data Capture (CDC) connector improvements, and enhanced dynamic Flink complex event processing (CEP).
If your deployment runs VVR 6.X, upgrade to VVR 6.0.4 as soon as possible to ensure deployment stability.
New features and improvements
Hologres connector
-
The Hologres connector in binlog mode now supports the TIMESTAMP data type.
-
Hologres catalogs support the ALTER TABLE statement, which modifies the properties of a Hologres table.
-
The Hologres source table connector supports filter pushdown, reducing the amount of data read from the source table. This improves read performance for large datasets.
CDC connectors
-
The MySQL CDC connector and the Postgres SQL CDC connector now support all features in Flink CDC V2.3.
-
The MySQL CDC connector supports specifying the consumer offset of binary log data.
Dynamic Flink CEP
-
Use the WITHIN clause to specify the time interval between events in a pattern.
-
Specify a condition in a JSON-formatted rule description to pass parameters.
-
Error handling improvements: the error message for unsupported conditions is now more informative. If a deployment pattern parsed from an aviator condition is invalid, the error is silently ignored and the deployment continues without failing.
Static CEP
The MATCH_RECOGNIZE clause is enhanced with the following clauses: SHOW TIMEOUT MATCHES, Not Next, Consecutive, Until, Followed By, Followed By Any, and Not Followed By.
Other improvements
-
The Message Queue for Apache Kafka source table connector can now verify that the consumer group specified in a deployment matches an existing consumer group.
-
The Log Service DataStream connector is now available. For more information, see SLS DataStream Connector.
Fixed issues
-
The error messages for the MySQL CDC connector are improved: the message when the connector fails to consume binary log data is now clearer, and the message for duplicate server IDs is more descriptive.
-
Fixed CVE-2022-25857, a security vulnerability in SnakeYAML V1.27.
-
Error descriptions for NullPointerException (NPE) and array-index out of bounds are improved for clarity.