GanosBase uses URI-based path strings to locate vector data in Object Storage Service (OSS) buckets, self-managed MinIO buckets, and Hadoop Distributed File System (HDFS) clusters. Each storage system uses a different URI scheme and parameter set.
OSS paths
oss://<access_id>:<secret_key>@[<Endpoint>]/<bucket>/path_to/fileExample:
oss://LTAI5tExampleKey:xXxExampleSecret@oss-cn-hangzhou-internal.aliyuncs.com/my-bucket/geodata/points.shp| Parameter | Description |
|---|---|
access_id | AccessKey ID of the AccessKey pair used to access the OSS bucket. See Obtain an AccessKey pair. |
secret_key | AccessKey secret of the AccessKey pair. |
Endpoint | (Optional) Internal endpoint of the OSS bucket. Use the internal endpoint to keep traffic within Alibaba Cloud's private network. See OSS endpoints. |
/<bucket>/path_to/file | Path to the object in the OSS bucket. |
Shapefile requirement: If the file is a Shapefile, upload the .shp, .shx, and .dbf files to the same folder in the OSS bucket. All three file types are required.
Network requirement: Place the ApsaraDB RDS instance and the OSS bucket in the same region, and use the internal endpoint to ensure data accessibility.
MinIO paths
MinIO access is supported only in hybrid cloud environments.
mio://<id>:<key>@<host>[:<port>]/<bucket>/path_to/fileExample:
mio://EXAMPLEID:EXAMPLEKEY@minio.internal.example.com:9000/my-bucket/geodata/points.shp| Parameter | Description |
|---|---|
id | MinIO access ID. |
key | MinIO access key. |
host | Hostname or IP address of the MinIO server. |
port | (Optional) Port of the MinIO server. If omitted, the HTTPS port is used. |
/<bucket>/path_to/file | Path to the file in the MinIO bucket. |
Network requirement: Place the ApsaraDB RDS instance and the MinIO bucket in the same region and on the same internal network to get the best import performance.
HDFS paths
HDFS access is supported only in hybrid cloud environments.
HDFS://<user_name>@<host>[:<port>]/path_to/fileExample:
HDFS://hdfs-user@namenode.internal.example.com:8020/user/geodata/points.shp| Parameter | Description |
|---|---|
user_name | (Optional) HDFS user name. If omitted, defaults to hadoop. |
host | Endpoint of the Remote Procedure Call (RPC) service, as configured in the HDFS configuration file. |
port | (Optional) RPC port, as configured in the HDFS configuration file. |
/path_to/file | Path to the file in the HDFS file system. |
Network requirement: Place the ApsaraDB RDS instance and the HDFS cluster in the same Virtual Private Cloud (VPC) and communicate over the internal network to get the best import performance.
Storage path comparison
| Storage system | Scheme | Credentials | Address | Default when omitted |
|---|---|---|---|---|
| OSS | oss:// | AccessKey ID, AccessKey secret | Endpoint (optional) | — |
| MinIO | mio:// | Access ID, access key | host[:port] | HTTPS port |
| HDFS | HDFS:// | User name (optional) | host[:port] | hadoop user; no default port |