This topic describes how to synchronize data from Kafka to Hologres in real time.
Background information
Kafka is a distributed message queue service that features high throughput and scalability. It is widely used in scenarios such as log collection, metric data aggregation, streaming data processing, and online and offline analysis. Hologres seamlessly integrates with the big data ecosystem. You can use multiple methods, such as DataWorks Data Integration and Hologres Connector, to synchronize data from Kafka to Hologres in real time. Then, you can query, analyze, and process data with high concurrency and low latency. For more information, see Kafka Reader and Hologres Writer.
Use DataWorks to synchronize data from Kafka to Hologres in real time
The Data Integration service of DataWorks reads data from Kafka by using the Kafka SDK for Java and synchronizes the data to Hologres in real time.
For more information about DataWorks, see Overview.
Configure data sources.
Before you synchronize data, you must configure a Kafka data source as the source and a Hologres data source as the destination. For more information, see the following topics:
Configure a synchronization task.
After the data sources are configured, you can configure a synchronization task to synchronize data from Kafka to Hologres in real time. For more information, see the following topics:
Query the synchronized data.
After the data is synchronized, you can query the synchronized data in Hologres.
Use Hologres Connector to import data from Kafka to Hologres
You can also import data from Kafka to Hologres by using Hologres Connector. For more information, see hologres-connector-kafka.