The Dataphin metadata warehouse is a data warehouse that unifies the management of business metadata and compute engine metadata within Dataphin. It is located in a Dataphin project within the metadata warehouse tenant (OPS tenant) and consists of a series of periodic data integration nodes, SQL script nodes, and Shell nodes. To initialize the metadata warehouse, you must configure the compute engine type for the Dataphin system and initialize the metadata. This topic describes how to initialize the metadata warehouse using StarRocks as the compute engine.
Limits
Only accounts with the metadata warehouse tenant super administrator or system administrator role can perform the initialization.
Keep the credentials for the metadata warehouse tenant super administrator or system administrator role secure. Exercise caution when you log on to the system with the metadata warehouse tenant super administrator account.
Procedure
On the Dataphin home page, choose Management Center > System Settings from the top menu bar.
In the navigation pane on the left, choose System O&M > Metadata Warehouse Settings. On the Metadata Warehouse Settings page, click Start.
In the Select Initialization Engine Type step, select the StarRocks engine type.
ImportantIf the metadata warehouse is already initialized, the engine from the last successful initialization is selected by default. If you switch to an incompatible compute engine, the administration feature becomes unavailable.
Click Next.
On the Parameter Settings page, configure the StarRocks compute engine parameters.
Parameter
Description
JDBC URL
Enter the Java Database Connectivity (JDBC) URL for the StarRocks database cluster. The format is
jdbc:mysql://host1:port1,host2:port2. Enter thedatabaseandquery parametersin the second input box.NoteThe host is the IP address of the FE host in the StarRocks cluster. The port is the FE query port, which defaults to 9030.
Load URL
The URL for data import. Specify the IP address and HTTP port of the Front End (FE). The format is
fe_ip:http_port;fe_ip:http_port.NoteWhen you enter multiple IP addresses and port numbers, separate them with semicolons (;).
Username and Password
Enter the username and password for the StarRocks database cluster.
Meta Project
The logical project for metadata production and processing. Set this parameter to
dataphin_meta. Keep the name unchanged when you re-initialize. Otherwise, the initialization fails.Click Test Connection. After the connection test succeeds, click Next.
On the initialization page, click Start.
NoteThe system initialization takes approximately 15 minutes.
After a success message appears, click Finish to complete the configuration.
What to do next
After you initialize the metadata warehouse, configure the compute engine for your Dataphin instance. If you set the metadata warehouse engine to StarRocks, you can set the business tenant engine to any type except MaxCompute. For more information, see Compute Settings.