Realtime Compute for Apache Flink uses catalogs to centralize metadata from multiple data sources, providing unified metadata access through Flink SQL.
Why use a catalog
-
Unified management: Centralize metadata across systems for easier data discovery.
-
Simplified operations: Reference tables and functions directly in SQL without repeated definitions.
-
Improved efficiency: Reduce metadata hardcoding to speed up development.
-
Integration: Integrate with external metadata services such as Paimon and Hive.
Supported catalogs
|
Traditional data lakes and warehouses |
Relational and analytical databases |
|
Message-based and non-relational data sources |
Integrations and extensions |