When you create a Flink workspace, Realtime Compute for Apache Flink automatically creates directories in the associated Object Storage Service (OSS) bucket. These directories store files that your Flink jobs need or generate—checkpoints, savepoints, logs, and JAR packages. This topic describes the OSS bucket directory structure and explains how to upload, download, and delete artifacts.
OSS bucket directories
The following directories are created in the OSS bucket for each workspace.
| Directory | Contents |
|---|---|
artifacts |
JAR packages, additional dependencies, Python files, and Python dependencies that you upload |
sql-artifacts |
Files required by registered user-defined functions (UDFs) and connectors |
flink-jobs |
High availability (HA) information and checkpoint data for Flink jobs |
flink-savepoints |
Savepoint files created when you click Create Savepoint in the Flink development console |
flink-sessionclusters |
HA and checkpoint data for session clusters |
plan |
Resource configuration information used in expert mode |
logs |
Job logs, if you configure your job to write logs to OSS |
Manage artifacts
Upload, download, and delete operations are restricted to the artifacts directory.
Prerequisites
Before you begin, make sure that you have:
-
Access to the Management Portal
-
A cross-origin resource sharing (CORS) rule configured on the associated OSS bucket (see step 2 below)
Configure CORS and open the Artifacts page
-
Log on to the Management Portal and click Console in the Actions column of the target workspace.
-
In the Object Storage Service (OSS) console, configure a cross-origin resource sharing (CORS) rule for the associated OSS bucket.
Set Origin to
https://vvpsg.console.alibabacloud.com, select all methods for Allowed Methods, and set Allowed Headers to*.
-
In the OSS console, configure a CORS rule for the associated OSS bucket:
-
Set Origin to
https://vvpsg.console.alibabacloud.com -
Select all methods for Allowed Methods
-
Set Allowed Headers to
*
-
-
Return to the Flink development console. In the left navigation pane, click Artifacts.
Upload, download, or delete an artifact
On the Artifacts page, perform any of the following operations:
| Operation | Steps | Result |
|---|---|---|
| Upload an artifact | Click Upload Artifact and select a local file. | After the upload completes, click the artifact name to copy its OSS path. The path format is: oss://<Your attached OSS Bucket name>/artifacts/namespaces/<Namespace name>/<File name> |
| Download an artifact | In the Actions column, click Download. | The artifact file is downloaded to your local machine. |
| Delete an artifact | In the Actions column, click Delete. | The artifact file is permanently deleted from the OSS bucket. |
Enable transfer acceleration
Transfer acceleration improves upload and download speeds, especially for large files over long distances. Toggle on Transfer Acceleration in the upper-right corner of the Artifacts page.
Transfer acceleration depends on OSS transfer acceleration and incurs additional traffic fees. For billing details, see What fees am I charged for using transfer acceleration?.