All Products
Search
Document Center

Hologres:Use batch sync nodes of DataWorks to synchronize data from databases to Hologres

Last Updated:Aug 30, 2024

Hologres allows you to use batch sync nodes of DataWorks to synchronize data from databases to Hologres. Then, you can query, analyze, and process the data with high concurrency and low latency in Hologres. This topic describes how to use batch sync nodes of DataWorks to synchronize data from various types of databases to Hologres.

Prerequisites

  • DataWorks is activated. For more information, see Overview.

  • The database service from which you want to synchronize data is activated.

Note

If the preceding services are activated in different regions, check how to synchronize data across regions. For more information, see Network connectivity solutions.

Background information

Hologres is a real-time interactive analytics engine. It seamlessly integrates with the big data ecosystem and DataWorks. You can use batch sync nodes provided by the Data Integration service of DataWorks to synchronize data from databases to Hologres, and then query, analyze, and process the data with high concurrency and low latency.

Common types of databases from which you can use batch sync nodes to synchronize data include ApsaraDB RDS for MySQL, Oracle, PolarDB, and SQL Server.

Note

For more information about supported database types, see Supported data source types, Reader plug-ins, and Writer plug-ins.

For more information about how data is synchronized, see MySQL Reader, Oracle Reader, PolarDB Reader, SQL Server Reader, and Hologres Writer.

Procedure

  1. Configure connections.

    Before you use a batch sync node to synchronize data from a source database to Hologres, you must configure connections to the source database and Hologres.

  2. Configure a batch sync node.

    After the connections are configured, you can configure a batch sync node to synchronize data from the source database to Hologres. You can configure the batch sync node on the codeless UI or in the code editor based on your business requirements.

  3. Query the synchronized data.

    After the data is synchronized, you can query the synchronized data in Hologres.

    SELECT * FROM rds_test;