This release notes page covers the major feature changes and bug fixes in Realtime Compute for Apache Flink released on June 4, 2025.
The upgrade rolls out gradually. Check the latest announcement in the Realtime Compute for Apache Flink console. New features in this version are available only after the upgrade completes for your account. To request an expedited upgrade, submit a ticket.
If you are upgrading, see Before you upgrade for incompatible changes that may affect your jobs.
Overview
This release includes platform updates, a new engine version, connector enhancements, and performance and security improvements.
Platform updates
Platform updates focus on developer experience and operations efficiency. Highlights:
Git integration: Bidirectional synchronization of SQL code and job configurations with GitHub, GitLab, and Gitee remote repositories, with built-in conflict resolution.
Simple Log Service (SLS) integration: Job startup logs, runtime events, and resource usage data are persisted to SLS for historical querying and auditing.
Job log configuration: Log output is now configurable through a visual interface, reducing the risk of misconfiguration.
CloudMonitor alert notifications: Alert notifications now display job names, making it faster to identify the affected job.
Engine updates
Ververica Runtime (VVR) 11.1 is now generally available. Built on Apache Flink 1.20.1, VVR 11.1 includes the following new features, enhancements, and fixes.
Before you upgrade
Before upgrading, review Upgrade the engine version of a deployment and the VVR version numbering strategy.
Incompatible changes
Java SDK — JDK 11 required: JDK 11 is now the standard runtime environment, and JDK 8 support has ended. If your JAR jobs were compiled with JDK 8, recompile and repackage them using JDK 11 before upgrading. SQL jobs are not affected.
Hologres connector — architectural changes: The Hologres connector has undergone architectural optimizations. Some connector options have been modified or removed. Before upgrading jobs that use the Hologres connector, check Connector options (VVR 11 or later) for the updated list of options.
New features
Real-time vectorization and inference powered by large language models (LLMs) The integration introduces model data definition language (DDL) statements and the
ML_PREDICTfunction for AI inference in real-time computation. See Model DDLs for DDL syntax, ML_PREDICT for function reference, and Integrate with Alibaba Cloud Model Studio for the setup guide.Vector construction: Integrates with Alibaba Cloud Model Studio to vectorize streaming data in real time, supporting real-time feature computation for recommendation systems and intelligent search.
Text inference: Generates summaries, translations, and other content using pre-trained models. Supports intelligent text processing for business use cases.
Capability enhancements
Scheduled backfill for materialized tables: Materialized tables now support creating workflows for periodic scheduling and historical data backfilling.
Real-time lookup joins with StarRocks dimension tables: Enables complex real-time analytical scenarios using StarRocks as a dimension table source.
SLS CDC and SLS-to-Paimon schema evolution: YAML Change Data Capture (CDC) now supports SLS data sources and automatic schema evolution from SLS to Paimon, simplifying metadata management in data lakehouse scenarios.
Flink CDC upgraded to version 3.4: Adds support for Flink CDC 3.4 core capabilities with enhanced data capture.
SLS data ingestion via YAML: Supports ingesting data from SLS and evolving schemas to Paimon.
MaxCompute data ingestion via YAML: Supports ingesting up to a terabyte of data into MaxCompute.
UNION ALL field alias retention: Flink SQL now retains field aliases in draft debugging results when the query contains
UNION ALL.
Performance improvements
PostgreSQL CDC connector — faster snapshot reads: An optimized data segmentation mechanism with asynchronous segmentation and parallel reading significantly improves snapshot reading performance.
Tair (Redis OSS-compatible) connector — time-based cache control: The new
cacheReloadTimeBlackListoption lets you disable caching during specific time periods daily, helping prevent resource contention during peak hours.
Security enhancements
Tair (Redis OSS-compatible) connector — TLS/SSL support: The connector now supports TLS/SSL connections via the
cacert.filepathoption. This is particularly useful in security-sensitive industries such as finance and government.Apache Parquet upgraded to 1.15.1: Fixes a remote code execution (RCE) vulnerability caused by data deserialization in the Parquet format.
MaxCompute identity reporting: The service now reports
applicationNameto the MaxCompute server, enabling accurate tracking of resource usage by Flink jobs and improving auditability of cross-system resource access.
Experience optimization
Input/output volume tracking: Source and sink operators now report input and output volumes, making it easier to verify data integrity and identify performance bottlenecks.
Features
Feature | Description | References |
Integrate with Git repositories | Bidirectional synchronization of SQL code and job configurations with GitHub, GitLab, and Gitee, with built-in conflict resolution. | |
Deliver messages to SLS | Persists job startup logs, runtime events, and resource usage data to Simple Log Service (SLS) for historical querying and auditing. | |
Job log configuration | Configure log exports to SLS, OSS, or Kafka through the console with a visual interface. | |
Ingest data into MaxCompute via YAML | Use the MaxCompute connector as a sink in YAML-based data ingestion jobs, supporting up to a terabyte of data. | |
Data ingestion optimization | The | |
Elasticsearch connector optimization | Null values can now be ignored when updating Elasticsearch tables, improving robustness of data writes. | |
Hologres connector optimization | Architectural optimizations have modified or removed some connector options. Check the version-specific reference before upgrading Hologres connector jobs. | |
MongoDB connector optimization | The new | |
MySQL connector optimization | The default value of the | |
Kafka connector optimization |
| |
ApsaraMQ for RocketMQ connector optimization | The new | |
Tair (Redis OSS-compatible) connector optimization |
| |
StarRocks connector optimization |
| |
Paimon connector optimization |
| |
AnalyticDB for PostgreSQL connector optimization | The | |
Materialized table optimization |
| |
Flink SQL support for Hive Kerberos authentication | Access Hive data in a Kerberized cluster through SQL, with bidirectional identity verification and encrypted transmission. | |
PyFlink Docker image upgrade | The base Docker image for PyFlink is upgraded to improve compatibility with different Python and glibc versions. | |
Window function optimization | SESSION WINDOW now follows Apache Flink 1.20 behavior, removing the coupling with aggregation statements that was required in VVR 8.x. Upgrade to the latest version to use the improved SESSION WINDOW. | |
SelectDB connector — now built-in | The SelectDB connector has graduated from public preview and is now a built-in connector in Realtime Compute for Apache Flink. | |
Table API job optimization | Built-in functions can now be called in Table API queries. | |
LLM-powered real-time vectorization and inference |
|
Major bug fixes
Connectors
SLS connector — null values on escape characters: Fixed null values being returned when consuming escape characters using the new architecture.
ApsaraMQ for RocketMQ connector — message loss in delayed topics: Fixed message loss in delayed topics.
Tair (Redis OSS-compatible) connector — concurrent write conflicts: Fixed concurrent write conflicts when writing to two Tair databases simultaneously.
Hologres connector — NullPointerException on lookup joins: Fixed
NullPointerExceptionerrors during lookup joins with a Hologres dimension table.Paimon connector — IllegalStateException on primary key writes: Fixed
IllegalStateExceptionerrors when writing to a Paimon table with a primary key.Lindorm connector — lookup joins return only one row: Fixed lookup joins with a Lindorm dimension table returning only a single matching row.
SQL and transformation
YAML transformation — Calcite parser rejects string comparison operators: Fixed compilation errors caused by the Calcite parser not recognizing string comparison operators.
CTAS — schema consolidation conflicts: Fixed schema consolidation conflicts during
CREATE TABLE AS SELECToperations.Hive catalog — access denied for non-Hive tables: Fixed access being denied for non-Hive tables in a Hive catalog.
Stability and performance
Paimon sinks — slow close times: Fixed excessive close times for Paimon sink operators.
Table filtering exceptions: Fixed table filtering exceptions. As a workaround for earlier VVR versions, use the
debezium.table.exclude.listoption.MiniBatch — data inconsistency: Fixed data inconsistency caused by MiniBatch processing.
PyFlink Table API — built-in function incompatibilities: Fixed incompatibilities between PyFlink Table API and Realtime Compute for Apache Flink built-in functions.