Connect Dataphin to AnalyticDB for PostgreSQL (ADBPG) so that Dataphin can read from or write to your ADBPG databases.
Overview
AnalyticDB for PostgreSQL (ADBPG) is an Alibaba Cloud MPP data warehouse compatible with ANSI SQL 2003, PostgreSQL, and Oracle ecosystems. It supports transaction processing, high-throughput writes, and unified stream-batch processing with hybrid row-column storage.
Permissions
A custom global role with the Create Data Source permission, or one of these system roles: super administrator, Data Source Administrator, Domain Architect, or project administrator.
Procedure
-
On the Dataphin home page, choose Management Center > Data Source Management.
-
On the Data Source page, click + Create Data Source.
-
On the Create Data Source page, go to the Relational Database section and select AnalyticDB for PostgreSQL.
You can also find it under Recently Used or search by keyword.
-
On the Create AnalyticDB for PostgreSQL Data Source page, configure the connection parameters for the data source.
-
Configure the basic information for the data source.
Parameter
Description
Datasource Name
Naming rules:
-
Can contain Chinese characters, letters, digits, underscores (_), and hyphens (-).
-
Maximum length: 64 characters.
Datasource Code
Used to reference tables in Flink_SQL nodes:
datasource_code.table_nameordatasource_code.schema.table_name. For environment-specific access:${datasource_code}.tableor${datasource_code}.schema.table. Develop a Dataphin data source table.ImportantThe data source code cannot be modified after it is configured.
You can preview data on the object details page in the asset directory and asset checklist only after the data source code is configured.
In Flink SQL, only MySQL, Hologres, MaxCompute, Oracle, StarRocks, Hive, SelectDB, and GaussDB data warehouse service (DWS) data sources are currently supported.
Version
Select 6.x or 7.x. The default value is 6.x.
Data Source Description
Optional description. Maximum: 128 characters.
Time Zone
Applies to time-formatted data in integration nodes. Default: Asia/Shanghai. Click Modify to change:
-
GMT: GMT-12:00, GMT-11:00, GMT-10:00, GMT-09:30, GMT-09:00, GMT-08:00, GMT-07:00, GMT-06:00, GMT-05:00, GMT-04:00, GMT-03:00, GMT-03:00, GMT-02:30, GMT-02:00, GMT-01:00, GMT+00:00, GMT+01:00, GMT+02:00, GMT+03:00, GMT+03:30, GMT+04:00, GMT+04:30, GMT+05:00, GMT+05:30, GMT+05:45, GMT+06:00, GMT+06:30, GMT+07:00, GMT+08:00, GMT+08:45, GMT+09:00, GMT+09:30, GMT+10:00, GMT+10:30, GMT+11:00, GMT+12:00, GMT+12:45, GMT+13:00, GMT+14:00.
-
Daylight saving time: Africa/Cairo, America/Chicago, America/Denver, America/Los_Angeles, America/New_York, America/Sao_Paulo, Asia/Bangkok, Asia/Dubai, Asia/Kolkata, Asia/Shanghai, Asia/Tokyo, Atlantic/Azores, Australia/Sydney, Europe/Berlin, Europe/London, Europe/Moscow, Europe/Paris, Pacific/Auckland, Pacific/Honolulu.
Data Source Configuration
Select the data source configuration mode:
-
Production + Development Data Source: Use separate production and development databases.
-
Production Data Source: Use one database for both environments.
Tag
Categorize data sources with tags. Manage data source tags.
-
-
Configure the connection parameters between the data source and Dataphin.
If you selected Production + Development Data Source, configure connection details for both environments. If you selected Production Data Source, configure only the production connection.
NoteSeparating production and development data sources isolates environments and protects production data. Dataphin also supports a single data source with identical parameters for both.
For Configuration Method, select JDBC URL or Host. Default: JDBC URL.
JDBC URL configuration
Parameter
Description
JDBC URL
One or more IP addresses, separated by commas (,).
Schema
Schema associated with the database user.
Username, Password
Database login credentials.
Host configuration
-
Host configuration
Parameter
Description
Server Address
IP address and port of the server.
Click +Add to add entries. Click
to remove one. At least one entry is required.dbname
Database name.
-
Parameter configuration
Parameter
Description
Parameter
-
Parameter name: Select an existing parameter name or enter a custom parameter name.
Custom parameter names can contain only letters, digits, periods (.), underscores (_), and hyphens (-).
-
Parameter value: This parameter is required if a parameter name is selected. The value can contain only letters, digits, periods (.), underscores (_), and hyphens (-). The value cannot exceed 256 characters.
NoteClick +Add Parameter to add parameters (maximum 30). Click
to remove.Schema (optional)
Schema to read from. Supports cross-schema table selection. Defaults to the schema in the data source configuration.
Username, Password
Database login credentials.
-
NoteSwitching from Host to JDBC URL mode auto-populates the JDBC URL based on the configured server address and port.
-
-
Configure advanced settings for the data source.
Parameter
Description
connectTimeout
Database connection timeout in seconds. Default: 900 (15 minutes).
Note-
A connectTimeout in the JDBC URL takes precedence.
-
For data sources created before Dataphin V3.11, the default is
-1(no timeout).
socketTimeout
Database socket timeout in seconds. Default: 1800 (30 minutes).
Note-
A socketTimeout in the JDBC URL takes precedence.
-
For data sources created before Dataphin V3.11, the default is
-1(no timeout).
Connection Retry Count
Automatic retry attempts after a connection timeout.
Note-
Default: 1. Range: 0 to 10.
-
Applies to Offline Integration Nodes and Global Quality (requires Asset Quality module). Node-level overrides are available in offline integration nodes.
-
NoteParameter precedence when duplicated across sections:
-
If a parameter is configured in the JDBC URL, Advanced Settings, and Host Configuration sections, the value in the JDBC URL takes precedence.
-
If a parameter is configured in both the JDBC URL and Advanced Settings sections, the value in the JDBC URL takes precedence.
-
If a parameter is configured in both the Advanced Settings and Host Configuration sections, the value in Advanced Settings takes precedence.
-
-
Select a Default Resource Group to run nodes for this data source, including database SQL, offline full database migration, and data preview.
-
Click Test Connection or OK to save the configuration and create the data source.
Test Connection validates connectivity to Dataphin. OK auto-tests all selected clusters. The data source can be created even if connection tests fail.