A region specifies the location of a DLF data center. An endpoint is the domain name used to access the DLF metadata API. DLF provides different endpoints for VPC and public network access in each supported region.
DLF regions and endpoints
VPC endpoints support both HTTP and HTTPS. Public endpoints support only HTTPS.
Paimon REST
Region | Region ID | VPC endpoint | Public endpoint | VPC's CIDR block |
China (Hangzhou) | cn-hangzhou | cn-hangzhou-vpc.dlf.aliyuncs.com | dlfnext.cn-hangzhou.aliyuncs.com | 100.115.114.0/25 |
China (Beijing) | cn-beijing | cn-beijing-vpc.dlf.aliyuncs.com | dlfnext.cn-beijing.aliyuncs.com | 100.115.116.0/25 |
China (Shanghai) | cn-shanghai | cn-shanghai-vpc.dlf.aliyuncs.com | dlfnext.cn-shanghai.aliyuncs.com | 100.115.117.0/25 |
China (Shenzhen) | cn-shenzhen | cn-shenzhen-vpc.dlf.aliyuncs.com | dlfnext.cn-shenzhen.aliyuncs.com | 100.115.115.0/25 |
China (Ulanqab) | cn-wulanchabu | cn-wulanchabu-vpc.dlf.aliyuncs.com | dlfnext.cn-wulanchabu.aliyuncs.com | 100.115.120.0/25 |
China (Hong Kong) | cn-hongkong | cn-hongkong-vpc.dlf.aliyuncs.com | dlfnext.cn-hongkong.aliyuncs.com | 100.115.126.0/25 |
Germany (Frankfurt) | eu-central-1 | eu-central-1-vpc.dlf.aliyuncs.com | dlfnext.eu-central-1.aliyuncs.com | 100.115.119.0/25 |
Japan (Tokyo) | ap-northeast-1 | ap-northeast-1-vpc.dlf.aliyuncs.com | dlfnext.ap-northeast-1.aliyuncs.com | 100.115.122.0/25 |
Singapore | ap-southeast-1 | ap-southeast-1-vpc.dlf.aliyuncs.com | dlfnext.ap-southeast-1.aliyuncs.com | 100.115.118.0/25 |
Indonesia (Jakarta) | ap-southeast-5 | ap-southeast-5-vpc.dlf.aliyuncs.com | dlfnext.ap-southeast-5.aliyuncs.com | 100.115.128.0/25 |
US (Silicon Valley) | us-west-1 | us-west-1-vpc.dlf.aliyuncs.com | dlfnext.us-west-1.aliyuncs.com | 100.115.124.0/25 |
US (Virginia) | us-east-1 | us-east-1-vpc.dlf.aliyuncs.com | dlfnext.us-east-1.aliyuncs.com | 100.115.131.128/25 |
Limitations and notes for the public endpoint
Naming constraints: Database and table names can only contain letters, digits, and specific symbols.
Disabled by default: The public endpoint is disabled by default. For instructions on how to enable it, see Enable public network access for DLF.
Performance considerations: The public endpoint has slightly higher latency than the internal endpoint.
Parameter configuration: You must configure the OSS public endpoint.
Iceberg REST
Region | Region ID | VPC endpoint | VPC's CIDR block |
China (Hangzhou) | cn-hangzhou | cn-hangzhou-vpc.dlf.aliyuncs.com/iceberg | 100.115.114.0/25 |
China (Beijing) | cn-beijing | cn-beijing-vpc.dlf.aliyuncs.com/iceberg | 100.115.116.0/25 |
China (Shanghai) | cn-shanghai | cn-shanghai-vpc.dlf.aliyuncs.com/iceberg | 100.115.117.0/25 |
China (Shenzhen) | cn-shenzhen | cn-shenzhen-vpc.dlf.aliyuncs.com/iceberg | 100.115.115.0/25 |
China (Ulanqab) | cn-wulanchabu | cn-wulanchabu-vpc.dlf.aliyuncs.com/iceberg | 100.115.120.0/25 |
China (Hong Kong) | cn-hongkong | cn-hongkong-vpc.dlf.aliyuncs.com/iceberg | 100.115.126.0/25 |
Germany (Frankfurt) | eu-central-1 | eu-central-1-vpc.dlf.aliyuncs.com/iceberg | 100.115.119.0/25 |
Japan (Tokyo) | ap-northeast-1 | ap-northeast-1-vpc.dlf.aliyuncs.com/iceberg | 100.115.122.0/25 |
Singapore | ap-southeast-1 | ap-southeast-1-vpc.dlf.aliyuncs.com/iceberg | 100.115.118.0/25 |
Indonesia (Jakarta) | ap-southeast-5 | ap-southeast-5-vpc.dlf.aliyuncs.com/iceberg | 100.115.128.0/25 |
US (Silicon Valley) | us-west-1 | us-west-1-vpc.dlf.aliyuncs.com/iceberg | 100.115.124.0/25 |
US (Virginia) | us-east-1 | us-east-1-vpc.dlf.aliyuncs.com/iceberg | 100.115.131.128/25 |
Enable public network access for DLF
This feature is currently in beta. For more information, see Public network connectivity for DLF now available.
Enable public network access
Public access to DLF is disabled by default for security. An administrator must enable it:
Log on to the DLF consol.
In the left-side navigation pane, choose Catalogs.
Click the target data catalog and then click the Catalog Configuration tab.
In the Advanced Settings section, add or modify the parameter
enable.openapiand set it totrue.
Configuration examples
The following examples show how to create a Paimon REST Catalog that connects to DLF over the public network. We recommend that you use Paimon client (Java and Python) version 1.4.1 or later.
Java
Options options = new Options();
// Configure the DLF public endpoint
options.set("uri", "https://dlfnext.cn-hangzhou.aliyuncs.com");
options.set("warehouse", "paimon_test");
options.set("dlf.region", "cn-hangzhou");
options.set("dlf.access-key-id", "YourAccessKeyId");
options.set("dlf.access-key-secret", "YourAccessKeySecret");
// You must configure the OSS public endpoint
options.set("dlf.oss-endpoint", "oss-cn-hangzhou.aliyuncs.com");
options.set("token.provider", "dlf");
Catalog restCatalog = new RESTCatalog(CatalogContext.create(options));The following table describes the parameters.
Parameter | Description | Example |
uri | The DLF OpenAPI public endpoint. See the "Public endpoint" column in the Paimon REST table above. | https://dlfnext.cn-hangzhou.aliyuncs.com |
warehouse | The DLF data catalog name. | paimon_test |
dlf.region | The region ID of the DLF service. | cn-hangzhou |
dlf.access-key-id | The AccessKey ID of your Alibaba Cloud account or RAM user. | - |
dlf.access-key-secret | The AccessKey secret of your Alibaba Cloud account or RAM user. | - |
dlf.oss-endpoint | The public endpoint of OSS. For more information, see Regions and endpoints. | oss-cn-hangzhou.aliyuncs.com |
token.provider | The authentication provider. Set this to | dlf |
Python
from pypaimon import CatalogFactory
options = {
# The Python client requires metastore type to be set to rest
'metastore': 'rest',
'uri': 'https://dlfnext.cn-hangzhou.aliyuncs.com',
'warehouse': 'paimon_test',
'dlf.region': 'cn-hangzhou',
'dlf.access-key-id': 'YourAccessKeyId',
'dlf.access-key-secret': 'YourAccessKeySecret',
# Configure this if you use STS temporary credentials
'dlf.security-token': 'YourSecurityToken',
'dlf.oss-endpoint': 'oss-cn-hangzhou.aliyuncs.com',
'token.provider': 'dlf',
}
rest_catalog = CatalogFactory.create(options)The following table describes the parameters.
Parameter | Description | Example |
metastore | The metastore type. Set this to | rest |
uri | The DLF OpenAPI public endpoint. See the "Public endpoint" column in the Paimon REST table above. | https://dlfnext.cn-hangzhou.aliyuncs.com |
warehouse | The DLF data catalog name. | paimon_test |
dlf.region | The region ID of the DLF service. | cn-hangzhou |
dlf.access-key-id | The AccessKey ID of your Alibaba Cloud account or RAM user. | - |
dlf.access-key-secret | The AccessKey secret of your Alibaba Cloud account or RAM user. | - |
dlf.security-token | The STS security token. Not required if you use a permanent AccessKey pair. | - |
dlf.oss-endpoint | The public endpoint of OSS. For more information, see Regions and endpoints. | oss-cn-hangzhou.aliyuncs.com |
token.provider | The authentication provider. Set this to | dlf |