Realtime Compute for Apache Flink supports multiple table types and connectors for reading from and writing to external storage through Flink SQL and the DataStream API.
Table types
Realtime Compute for Apache Flink defines tables through Flink SQL or the DataStream API to read from and write to external storage. Flink SQL supports the following table types:
-
Source table: Entry point for a data stream. Continuously reads raw event data from external systems such as Kafka or MySQL CDC.
-
Dimension (lookup) table: Reference table that enriches streaming data by joining static or slowly changing dimension data, such as user or product details.
-
Sink table: Exit point for data processing. Writes results such as aggregated or joined data to a destination system such as a data warehouse, database, or message queue.
Supported connectors
|
Relational database |
NoSQL database |
Message queue |
|
Data warehouse |
Data lake |
Log and object storage services |
|
Tools and debugging |
Key-value and time series databases |
General |
Connector support details
|
Connector |
Flink SQL |
Flink CDC |
Execution mode |
API type |
Sink updates |
|||
|
Source table |
Dimension table |
Sink table |
Data source |
Sink |
||||
|
√ |
√ |
√ |
√ |
× |
Streaming mode |
SQL, DataStream, and Flink CDC |
Yes |
|
|
√ |
√ |
√ |
× |
√ |
Streaming and batch |
SQL, DataStream, and Flink CDC |
Yes |
|
|
√ |
× |
√ |
√ |
√ |
Streaming |
SQL, DataStream, and YAML for data ingestion |
Only inserts are supported. |
|
|
√ |
√ |
√ |
× |
√ |
Streaming and batch |
SQL, DataStream, and Flink CDC |
Only inserts are supported. |
|
|
√ |
√ |
√ |
× |
√ |
Streaming and batch modes |
SQL and Flink CDC |
Yes |
|
|
√ |
× |
√ |
√ |
× |
Streaming mode |
SQL, DataStream, and Flink CDC |
Only inserts are supported. |
|
|
√ |
√ |
√ |
× |
√ |
Streaming and batch modes |
SQL, DataStream, and Flink CDC |
Yes |
|
|
√ |
× |
√ |
× |
× |
Streaming and batch modes |
SQL and DataStream |
Only inserts are supported. |
|
|
√ |
√ |
√ |
√ |
× |
Streaming mode |
SQL, DataStream, and Flink CDC |
Yes |
|
|
√ |
√ |
√ |
× |
× |
Streaming and batch modes |
SQL |
Yes |
|
|
√ |
× |
√ |
× |
× |
Streaming and batch modes |
SQL and DataStream |
Only inserts are supported. |
|
|
Note
The connector is being deprecated. Use the MySQL connector instead. |
× |
√ |
√ |
Use the MySQL connector. |
× |
Streaming and batch modes |
SQL |
Yes |
|
√ |
× |
√ |
× |
× |
Streaming mode |
SQL and DataStream |
Only inserts are supported. |
|
|
× |
√ |
√ |
× |
× |
Streaming mode |
SQL |
Yes |
|
|
× |
√ |
√ |
× |
× |
Streaming mode |
SQL |
Yes |
|
|
× |
× |
√ |
× |
× |
Streaming mode |
SQL |
Yes |
|
|
× |
√ |
√ |
× |
× |
Streaming mode |
SQL |
Yes |
|
|
√ |
√ |
√ |
× |
× |
Streaming and batch modes |
SQL |
Yes |
|
|
× |
√ |
√ |
× |
× |
Streaming and batch modes |
SQL |
Yes |
|
|
× |
× |
√ |
× |
× |
Streaming and batch modes |
SQL |
Yes |
|
|
√ |
× |
√ |
× |
√ |
Streaming mode |
SQL and Flink CDC |
Yes |
|
|
√ |
√ |
√ |
× |
× |
Streaming and batch modes |
SQL and DataStream |
Yes |
|
|
× |
× |
√ |
× |
× |
Streaming and batch modes |
SQL |
Yes |
|
|
√ |
√ |
√ |
× |
× |
Streaming mode |
SQL |
Yes |
|
|
× |
× |
√ |
× |
× |
Streaming and batch modes |
SQL and DataStream |
Yes |
|
|
× |
× |
√ |
× |
× |
Streaming mode |
SQL |
Only inserts are supported. |
|
|
√ |
× |
× |
√ |
× |
Streaming mode |
SQL and Flink CDC |
N/A |
|
|
√ |
√ |
√ |
× |
√ |
Streaming and batch modes |
SQL and Flink CDC |
Yes |
|
|
√ |
× |
√ |
× |
√ |
Streaming and batch modes |
SQL and Flink CDC |
Yes |
|
|
√ |
√ |
× |
× |
× |
Streaming and batch modes |
SQL |
N/A |
|
|
× |
× |
√ |
× |
× |
Streaming and batch modes |
SQL |
Yes |
|
|
√ |
× |
× |
× |
× |
Streaming and batch modes |
SQL |
N/A |
|
|
× |
× |
√ |
× |
√ |
Streaming and batch modes |
SQL and Flink CDC |
Yes |
|
|
√ |
× |
√ |
× |
× |
Streaming and batch modes |
SQL and DataStream |
Yes |
|