Built on Flink CDC, Data Ingestion is a low-code, one-stop framework for syncing data from heterogeneous sources to destinations. Simply configure YAML jobs to seamlessly ingest full and incremental data with millisecond latency. This makes it ideal for real-time data warehousing and streaming lakehouse architectures.
This set of documents describe the concepts and configuration items for developing Flink CDC Data Ingestion jobs.
Feature description | Document |
Job draft structure | |
Data source and sink configurations | |
Data processing and transformation methods | |
Data flow rule configurations | |
Global job configurations | |
Schema evolution configurations | |
Built-in functions | |
User-defined functions |