Use the data catalog feature in DataWorks to copy a MaxCompute internal table into Hologres and run real-time queries against it.
How it works
Data moves in two stages:
-
DataWorks creates a Hologres foreign table that maps to the source MaxCompute table. This mapping is handled by executing the
IMPORT FOREIGN SCHEMAstatement against Hologres. -
Data is loaded from the foreign table into a Hologres internal table, where Hologres can query it at full speed.
Prerequisites
Before you begin, make sure you have:
-
A MaxCompute project (source) — Create a MaxCompute project
-
A Hologres instance (destination) — Create an instance
-
Both associated with the same DataWorks workspace (connectivity) — The MaxCompute project and Hologres instance must both be added as computing resources in the same workspace, and the network connectivity test must pass. See Associate a computing resource with a workspace (Participate in Public Preview of Data Studio turned on)
Limitations
You can create a foreign table and read data from it only if the source MaxCompute table already exists.
Synchronize data from MaxCompute to Hologres
This procedure has two main steps: navigating to the source table and triggering the synchronization node wizard, then configuring the node parameters.
Step 1: Open the node configuration tab
-
Go to the Workspaces page in the DataWorks console. In the top navigation bar, select the region where your workspace is located. Find the workspace, then choose Shortcuts > Data Studio in the Actions column.
-
In the left-side navigation pane of Data Studio, click the
icon to open the DATA CATALOG pane. -
In the MaxCompute directory, find the internal table you want to synchronize in the Table folder, right-click the table name, and select Data Synchronization to Hologres.
-
In the popover that appears, select the path where you want to create the node, then click OK.
-
In the popover that appears, enter a name for the node and press Enter to open the node configuration tab.
Step 2: Configure the node
On the configuration tab, set the parameters for the synchronization node.
Parameters in the Settings for Source Table (MaxCompute) section are filled in automatically based on the table you selected in Step 1—no manual input is needed for those fields.
For a full description of all parameters, see Synchronize data to Hologres.