Before you run jobs, you can upload resources such as files and JAR packages or load file directories to E-MapReduce (EMR) Serverless Spark. This ensures that EMR Serverless Spark can seamlessly access required resources when you run jobs. This topic describes the operations that you can perform on the Managed File Directory and Integrated File Directory tabs of the Files page in the EMR console.
Background information
Managed File Directory: On this tab, you can upload files from your on-premises machine. This allows EMR Serverless Spark to access the files when you run jobs.
Integrated File Directory: On this tab, you can mount an Object Storage Service (OSS) bucket as a file system to notebook sessions. This allows notebook sessions to access the files stored in OSS without the need to manually upload the files.
Managed File Directory
Upload a file
Go to the Files page.
Log on to the EMR console.
In the left-side navigation pane, choose .
On the Spark page, click the name of the desired workspace.
In the left-side navigation pane of the EMR Serverless Spark page, click Files.
On the Managed File Directory tab of the Files page, click Upload File.
In the Upload File dialog box, click the area in a dotted-line rectangle to select a file or drag a file to the area.
Manage a file and a folder
On the Managed File Directory tab, you can manage files and folders.
Manage a file
Download a file: Find the desired file and click Download File in the Actions column.
Copy the path of the file: Find the desired file and click Copy Address in the Actions column.
Delete a file: Find the desired file and click Delete in the Actions column.
Create and manage a folder
Create a folder: Click Create Folder. In the Create Folder dialog box, configure the Name parameter and click OK.
Rename a folder: Find the desired folder and click Rename in the Actions column.
Delete a folder: Find the desired folder and click Delete in the Actions column.
Integrated File Directory
You can mount integrated file directories only to the driver of a notebook.
After you create integrated file directories, users that have editing permissions can edit files and folders on the Files page, and users that have data development permissions can perform read and write operations on files and folders by using a notebook.
Create a file directory
On the Integrated File Directory tab of the Files page, click Create File Directory.
In the Create File Directory dialog box, configure the parameters and click OK.
Parameter
Description
Name
The name of the file directory.
OSS Path
Select an OSS path from the drop-down list. Make sure that you have permissions to access the path.
Mount Directory
The default value is
/mnt/workspace. You can modifyworkspacein the/mntpath based on your business requirements.
Delete a file directory
When you delete a file directory, the file directory is unmounted from OSS. However, the files in the OSS path are not deleted.
On the Integrated File Directory page, find the file directory and click Delete in the Actions column.
In the Delete File Directory message, click OK.
What to do next
After you upload resources, you can use an uploaded file as the dependency or input data source when you develop a job.