Create an Easysearch data source to write data from Dataphin to Easysearch.
Permissions
Only super administrators, data source administrators, solution architects, project administrators, and custom global roles with the Create Data Source permission can create data sources.
Procedure
-
On the Dataphin homepage, in the top menu bar, choose Management Hub > Data Source Management.
-
On the Data Source page, click + New Data Source.
-
On the New Data Source page, in the NoSQL area, select Easysearch.
You can also select Easysearch from the Recently Used area, or enter Easysearch in the search box to find it.
-
On the New Easysearch Data Source page, configure the connection parameters.
-
Configure the basic information for the data source.
Parameter
Description
Data Source Name
Enter a name for the data source. The naming convention is as follows:
-
The name can contain Chinese characters, uppercase and lowercase letters, digits, underscores (_), and hyphens (-).
-
The name can be up to 64 characters long.
Data Source Code
With the data source code configured, you can access Dataphin data source tables directly in Flink_SQL nodes or through the Dataphin JDBC client. Use the format
Data Source Code.Table NameorData Source Code.Schema.Table Namefor direct access. To automatically switch data sources based on the task execution environment, use the variable format${Data Source Code}.tableor${Data Source Code}.schema.table. For more information, see Develop with Dataphin data source tables.ImportantThe data source code cannot be modified after it is configured.
You can preview data on the object details page in the asset directory and asset checklist only after the data source code is configured.
In Flink SQL, only MySQL, Hologres, MaxCompute, Oracle, StarRocks, Hive, SelectDB, and GaussDB data warehouse service (DWS) data sources are currently supported.
Version
Only version 1.7.0 is supported.
Description
A brief description of the data source, up to 128 characters long.
Data Source Configuration
Select the data source type to configure:
-
If your business data source is separate for production and development, select Production + Development Data Source.
-
If your business data source is not separate, select Production Data Source.
Tag
Add tags to classify the data source. For more information, see Manage data source tags.
-
-
Configure the connection parameters between the data source and Dataphin.
If you selected Production + Development Data Source in the previous step, configuration pages for both environments are displayed. If you selected Production Data Source, only the configuration page for the production data source is displayed.
NoteWe recommend configuring separate production and development data sources to isolate environments and reduce the impact on production. However, you can also configure them as the same data source with identical parameter values.
Parameter
Description
ES URL
The access URL for Easysearch, such as
http://hostname:9200.Username, Password
The username and password to access the Easysearch instance.
-
-
Select the Default Resource Group. This resource group is used to run tasks related to the data source, such as database SQL, offline full database migration, and data preview.
-
Click Test Connection or click OK to save the configuration and create the Easysearch data source.
Test Connection verifies connectivity between the data source and Dataphin. If you click OK directly, the system tests the connection for all selected clusters automatically. The data source is created even if the connection tests fail.