Dataphin:Create a Lindorm data source

Permissions

Only custom global roles with the new data source permission and the system roles Super Administrator, Data Source Administrator, Plate Architect, and Project Administrator can create data sources.

Procedure

1. On the Dataphin homepage, click management center > data source management in the top navigation bar.

2. On the data source page, click + new data source.

3. On the new data source page, in the NoSQL section, select Lindorm.

   If you recently used Lindorm, you can also find it in the Recently Used section or search for it by keyword.

4. On the new Lindorm data source page, configure the connection parameters for the data source.

   1. Configure basic information for the data source

      Parameter	Description
      data source name	The data source name must meet the following requirements: Can contain only Chinese characters, letters, numbers, underscores (_), and hyphens (-). Cannot exceed 64 characters in length.
      data source code	Once configured, you can access Dataphin data source tables in Flink_SQL tasks or through the Dataphin JDBC client by using the format data_source_code.table_name or data_source_code.schema.table_name. To automatically switch data sources based on the task execution environment, use the variable format ${data_source_code}.table or ${data_source_code}.schema.table. For more information, see Develop Dataphin data source tables. Important The data source code cannot be modified after it is configured. You can preview data on the object details page in the asset directory and asset checklist only after the data source code is configured. In Flink SQL, only MySQL, Hologres, MaxCompute, Oracle, StarRocks, Hive, SelectDB, and GaussDB data warehouse service (DWS) data sources are currently supported.
      data source description	Enter a brief description of the data source. The description cannot exceed 128 characters.
      Data source configuration	Select the data source to configure: If your business data source distinguishes between production and development data sources, select Production + Development Data Source. If your business data source does not distinguish between production and development data sources, select Production Data Source.
      tag	You can use tags to categorize data sources. To create tags, see Manage data source tags.

   2. Configure connection parameters between the data source and Dataphin

      If you select Production + Development Data Source, configure the connection information for both environments. If you select Production Data Source, configure only the production connection information. The required parameters vary by Connection Types, as described in the following table.

      Note

      We recommend configuring separate instances for production and development to isolate environments and reduce the risk of development activities affecting production. However, you can use identical parameter values to configure them as the same data source.

      Spark ETL

      Parameter	Description
      core-site.xml	Upload the Lindorm configuration files: core-site.xml, hdfs-site.xml, and hive-site.xml.
      hdfs-site.xml
      hive-site.xml
      JDBC URL	Enter the JDBC URL for Lindorm. The format is jdbc:hive2://host:port/;?token=xxx.
      username and password	The username and password for accessing the Lindorm instance.

      MySQL engines

      Parameter	Description
      JDBC URL	Enter the JDBC URL for Lindorm, for example, jdbc:mysql://host:port.
      username and password	The username and password for accessing the Lindorm instance.

      HBase wide table

      Parameter	Description
      endpoint	The endpoint for connecting to Lindorm. To obtain the connection address, see Cloud-native multi-model database Lindorm (Wide Table) - Connect to and use an instance.
      namespace	The namespace for the Lindorm instance. The default value is default.
      username and password	The username and password for accessing the Lindorm instance.
      connection parameters (optional)	Additional connection parameters for Lindorm. Use JSON format.

5. Select the default resource group, which runs tasks related to the current data source, such as database SQL, offline full database migration, and data preview.

6. Click test connection to verify the connection, or click OK to save the configuration and create the Lindorm data source.

   Clicking test connection verifies that Dataphin can connect to the data source. If you click OK directly, the system automatically tests the connection for all selected clusters, but creates the data source even if connection tests fail.