Dataphin:Create a Doris data source

Permissions

You can create data sources if you have a custom global role with the Create Data Source permission, or if you are a super administrator, data source administrator, domain architect, or project administrator.

Procedure

1. On the Dataphin homepage, click Management Center > Data Source Management in the top navigation bar.

2. On the Data Source Management page, click +New Data Source.

3. On the new data source page, under the Big Data Storage section, select Doris.

   If you have used Doris recently, you can also find it in the Recently Used section. Alternatively, you can enter "Doris" in the search box to find it quickly.

4. On the New Doris Data Source page, configure the connection parameters.

   1. Configure the basic information for the data source.

      Parameter	Description
      Data source name	Follow these naming conventions: Can contain only Chinese characters, letters, digits, underscores (_), and hyphens (-). Cannot exceed 64 characters in length.
      Data source code	After you configure the data source code, you can reference tables from this data source in Flink SQL tasks using the format data_source_code.table_name or data_source_code.schema.table_name. To automatically access the data source corresponding to the current environment, use the variable format ${data_source_code}.table or ${data_source_code}.schema.table. For more information, see Dataphin data source table development or . Important The data source code cannot be modified after it is configured. You can preview data on the object details page in the asset directory and asset checklist only after the data source code is configured. In Flink SQL, only MySQL, Hologres, MaxCompute, Oracle, StarRocks, Hive, SelectDB, and GaussDB data warehouse service (DWS) data sources are currently supported.
      Data source description	Enter a brief description of the data source, limited to 128 characters.
      Data source configuration	Specify whether you use separate production and development data sources: If your business data source is separated, select Production + development data source. If not, select Production data source.
      Tag	Use tags to categorize data sources. For information about how to create a tag, see Manage data source tags.

   2. Configure the connection parameters between the data source and Dataphin.

      If you set Data source configuration to Production + development data source, configure connection parameters for both the production data source and the development data source. If you set Data source configuration to Production data source, configure only the connection parameters for the production data source.

      Note

      Typically, the production and development data sources should be configured as separate instances to ensure environment isolation and prevent development work from affecting the production system. However, Dataphin allows you to configure them as the same data source by using identical parameter values.

      Parameter	Description
      JDBC URL	Enter the connection string for the data source. The format is jdbc:mysql://host:port/dbname.
      Username and password	The username and password for accessing the Doris data source.
      Arrow Flight SQL port (Optional)	The high-speed columnar (Arrow) read port for the Doris FE. This port is used for large-scale data synchronization and defaults to 8070. Express synchronization tasks use this port to read data from Doris via the Arrow Flight SQL protocol.
      FE node URL	Enter the web server URL for the FE nodes in the format {FE IP}:{Http Port}. The default port is typically 8030. You can enter multiple URLs, separated by commas.
      SSL encryption	If you need to use an encrypted connection, enable SSL encryption, upload the Truststore certificate, and enter the Truststore certificate password.

   3. Configure the advanced settings.

      Parameter	Description
      connectTimeout	The connection timeout for the database, in milliseconds. The default value is 900000 (15 minutes). Note If the JDBC URL already contains a connectTimeout parameter, that value is used. For data sources created in Dataphin versions earlier than V3.11, the default connectTimeout is -1, which indicates no timeout.
      socketTimeout	The socket timeout for the database, in milliseconds. The default value is 1800000 (30 minutes). Note If the JDBC URL already contains a socketTimeout parameter, that value is used. For data sources created in Dataphin versions earlier than V3.11, the default socketTimeout is -1, which indicates no timeout.
      Connection retries	If a connection times out, Dataphin retries up to the specified number of times. If all retries fail, the connection attempt is marked as failed. Note The default is 1 retry. Valid values range from 0 to 10. The connection retry setting applies by default to offline integration tasks and data quality checks. The data quality feature requires the asset quality module. For offline integration tasks, you can also configure retries at the individual task level.

5. Select a default resource group. This resource group runs tasks related to the data source, such as executing SQL queries, performing offline full-database migrations, and generating data previews.

6. Click Test Connection or OK to create the data source.

   Clicking Test Connection validates the connection settings. If you click OK, this test is performed automatically. The data source is created even if the connection test fails.