GanosBase supports file import from Alibaba Cloud Object Storage Service (OSS), MinIO, and Hadoop Distributed File System (HDFS).
OSS path
Syntax:
oss://<access_key_id>:<secret_key>@[<Endpoint>]/<bucket>/path_to/fileaccess_key_id, secret_key, and bucket are required. Endpoint is optional — if omitted, GanosBase resolves the endpoint automatically. When omitting Endpoint, start the path with a forward slash (/).
Parameters:
| Parameter | Required | Description |
|---|---|---|
access_key_id | Yes | Your AccessKey ID |
secret_key | Yes | Your AccessKey secret |
Endpoint | No | The OSS region endpoint. If omitted, GanosBase resolves it automatically. |
bucket | Yes | The name of the OSS bucket |
path_to/file | Yes | The path to the file within the bucket |
Endpoint specifies the region where OSS resides. Make sure the cluster and OSS are in the same region, and use an internal endpoint for access. For more information, see OSS domain names.Example:
OSS://my_id:my_secret@oss-cn-hangzhou-internal.aliyuncs.com/my_bucket/my_folder/my_fileMinIO path
Syntax:
mio://<id>:<key>@<host>[:<port>]/<bucket>/path_to/fileid, key, host, and bucket are required. port is optional — if omitted, the HTTPS port is used.
Parameters:
| Parameter | Required | Description |
|---|---|---|
id | Yes | Your MinIO access key ID |
key | Yes | Your MinIO access key secret |
host | Yes | The hostname or IP address of the MinIO server |
port | No | The MinIO server port. Defaults to the HTTPS port if omitted. |
bucket | Yes | The name of the MinIO bucket |
path_to/file | Yes | The path to the file within the bucket |
Make sure the cluster and MinIO are in the same region and Virtual Private Cloud (VPC), and use an internal network address for access.
Example:
MIO://my_id:my_secret@250.0.0.1:8080/my_bucket/my_folder/my_fileHDFS path
Syntax:
HDFS://<user_name>@<host>:<port>/path_to/filehost and port are required and must match the Remote Procedure Call (RPC) endpoint and port in your HDFS configuration file. user_name is optional — if omitted, hadoop is used as the default.
Parameters:
| Parameter | Required | Description |
|---|---|---|
user_name | No | The HDFS username. Defaults to hadoop if omitted. |
host | Yes | The RPC endpoint from the HDFS configuration file |
port | Yes | The RPC port from the HDFS configuration file |
path_to/file | Yes | The path to the file in HDFS |
Make sure the cluster and HDFS are in the same region and VPC, and use an internal IP address for access.
Examples:
Without user_name (defaults to hadoop):
HDFS://my_id@250.0.0.1:8081/my_folder/my_fileWith user_name specified:
HDFS://my_id:my_secret@250.0.0.1:8081/my_folder/my_file