Create a Snowflake data source to enable Dataphin to read business data from Snowflake.
Permissions
Only super administrators, data source administrators, domain architects, project administrators, and custom global roles with the Create Data Source permission can create data sources.
Procedure
-
On the Dataphin homepage, choose Management Center > Data Source Management in the top menu bar.
-
On the Data Source page, click + New Data Source.
-
In the Big Data section of the New Data Source page, select Snowflake.
You can also select Snowflake from Recently Used or search for it by name.
-
On the Create Snowflake Data Source page, configure the connection parameters.
-
Configure the basic information for the data source.
Parameter
Description
Datasource Name
Data source name. Requirements:
-
Can contain Chinese characters, uppercase and lowercase letters, digits, underscores (_), and hyphens (-).
-
Cannot exceed 64 characters in length.
Datasource Code
Once configured, access Dataphin data source tables in Flink_SQL tasks or through the Dataphin JDBC client using
DataSourceCode.TableNameorDataSourceCode.schema.TableName. To auto-switch data sources by execution environment, use${DataSourceCode}.tableor${DataSourceCode}.schema.table. Dataphin data source table development methods.ImportantThe data source code cannot be modified after it is configured.
You can preview data on the object details page in the asset directory and asset checklist only after the data source code is configured.
In Flink SQL, only MySQL, Hologres, MaxCompute, Oracle, StarRocks, Hive, SelectDB, and GaussDB data warehouse service (DWS) data sources are currently supported.
Version
Currently, only version 3.27.0 is supported.
Data Source Description
Description of the data source. Maximum 128 characters.
Time Zone
Integration tasks process time data in the selected time zone. Default: Asia/Shanghai. Click Modify to change. Options:
-
GMT: GMT-12:00, GMT-11:00, GMT-10:00, GMT-09:30, GMT-09:00, GMT-08:00, GMT-07:00, GMT-06:00, GMT-05:00, GMT-04:00, GMT-03:00, GMT-03:00, GMT-02:30, GMT-02:00, GMT-01:00, GMT+00:00, GMT+01:00, GMT+02:00, GMT+03:00, GMT+03:30, GMT+04:00, GMT+04:30, GMT+05:00, GMT+05:30, GMT+05:45, GMT+06:00, GMT+06:30, GMT+07:00, GMT+08:00, GMT+08:45, GMT+09:00, GMT+09:30, GMT+10:00, GMT+10:30, GMT+11:00, GMT+12:00, GMT+12:45, GMT+13:00, GMT+14:00.
-
Daylight Saving Time: Africa/Cairo, America/Chicago, America/Denver, America/Los_Angeles, America/New_York, America/Sao_Paulo, Asia/Bangkok, Asia/Dubai, Asia/Kolkata, Asia/Shanghai, Asia/Tokyo, Atlantic/Azores, Australia/Sydney, Europe/Berlin, Europe/London, Europe/Moscow, Europe/Paris, Pacific/Auckland, Pacific/Honolulu.
Datasource Config
Select based on your environment separation:
-
If your business data source is separated, select Production + Development Data Source.
-
If your business data source is not separated, select Production Data Source.
Tag
Add tags to classify data sources. Manage data source tags.
-
-
Configure connection parameters.
If you selected Production + Development Data Source, configure connections for both environments. For Production Data Source, configure the production connection only.
NoteBest practice: use different data sources for production and development to isolate environments. However, you can use identical parameters for both.
Parameter
Description
Server Address
Format:
{Account}.snowflakecomputing.com. Only one endpoint is supported.Role
Snowflake access role. Must have warehouse usage permission.
Warehouse
Snowflake compute warehouse for data reads and writes. Must be running.
Database
Target database name. You must have access permission.
Schema
Database schema. Default: PUBLIC.
Username, Password
Credentials for authentication. Ensure the user has required data permissions.
Parameter Settings (Optional)
Click + Parameter Settings to add a row. Enter a Parameter Name and Parameter Value. Click the
icon to delete a row.Names and values support uppercase and lowercase letters, digits, periods (.), underscores (_), and hyphens (-). Maximum 256 characters.
-
-
Select the Default Resource Group for running tasks on this data source (database SQL tasks, full offline database migrations, data previews).
-
Click Test Connection or OK to save the configuration and create the Snowflake data source.
Test Connection verifies connectivity. OK saves the data source and auto-tests all clusters. The data source is created even if tests fail.