Hologres - Support for real-time data synchronization from Kafka to Hologres with ETL operations
Jun 01 2023
HologresContent
Target customers: all Hologres customers. Features released: Data can be synchronized from Kafka to Hologres in real time. During the synchronization, users can parse JSON-formatted messages in Kafka in a custom manner and perform other basic data processing to implement real-time extract, transform, load (ETL) operations. Values can be obtained based on keys in JSON-formatted paths, and dynamic key-value expansion is supported. This feature is suitable for scenarios in which the format of messages in kafka changes. Simulated running during task configuration is supported. This way, users can know whether written data is correctly processed in advance.