The Personal Directory is a private workspace in Data Studio where each developer can create, develop, debug, and maintain code files independently, without affecting shared project resources.
File types
The Personal Directory supports two categories of files: My Files and Local Files.
My Files is the default directory, stored and managed by DataWorks at the root path (/). Files in My Files are not accessible from a terminal.
Local Files is an optional directory you add manually. It mounts an external storage location into your Personal Directory. The storage provider and path depend on how you configure your setup:
| Setup | Directory name | Storage provider | Storage path | Terminal access |
|---|---|---|---|---|
| Personal Development Environment with a dataset | Dataset mount path name | Network Attached Storage (NAS) or Object Storage Service (OSS) configured for the dataset | Dataset mount path, specified at instance creation | Yes |
| Personal Development Environment without a dataset | workspace | DataWorks | /mnt/workspace | Yes |
| No Personal Development Environment | Local directory name | Your local device | Path you select when adding the directory | No |
"Local" in Local Files means different things depending on your environment. With a Personal Development Environment instance, "local" refers to that instance, not your physical machine. Without one, "local" refers to your device, and your browser must have permission to access your files.
Access the Personal Directory
Go to the Workspaces page in the DataWorks console. In the top navigation bar, select a region. Find the target workspace and choose Shortcuts > Data Studio in the Actions column.
On the Data Studio page, click the
icon to open the data development page, then click Personal Directory in the directory tree.
Manage personal files
Create a personal file
In the Personal Directory, click My Files. In the toolbar:
To create a SQL file quickly, click the New SQL File icon.
To create a file in any other format, click the Create a file icon and specify a file extension to set the file type.
The following file types can be run directly from the Personal Directory:
.sql— SQL file.ipynb— Notebook file.py— Python file.sh— Shell file
The Personal Directory can read and write any file type that Visual Studio Code supports. Only the four types listed above have execution support. Other file types have no syntax highlighting, development environment, or run capability.
Add local files
To add a local directory (including its files and code repositories) to your Personal Directory, use either method:
Method 1: In the toolbar, click the
icon and select the directory to add.Method 2: In the Local Files directory, right-click and select Add Local Directory to Personal Directory... from the context menu.
To remove a local directory, right-click it and select Delete Local Directory From Personal Directory... This removes the directory from your Personal Directory but does not delete its contents.
Locate files
| Feature | How to use |
|---|---|
| Locate the currently open file | Click the icon to the right of Personal Directory to highlight the active file in the directory tree. |
| Open a directory in the terminal | In the Local Files directory of your Personal Development Environment, right-click the target directory and select Open In Integrated Terminal. |
| Search by filename | Use the search box above the Project Directory in Data Studio to search by filename. Up to 2,048 results are displayed. |
| Search by code snippet | Click the icon to the right of Personal Directory to search files by code snippet. See Code Search for details. |
Use personal files
Files in your Personal Directory can be used in three ways:
Run directly — Run
.sqland.pyfiles using the compute resource bound to the workspace.Submit to the Project Directory — Convert a file into a schedulable node and integrate it into a project workflow. Supported file types:
.ipynb,.sh,.py, and.sql.Submit as a MaxCompute resource or function — Register a
.pyfile as a MaxCompute resource or function for use in data development nodes.
Run a file in the Personal Directory
This method is suited for daily development, testing, and ad hoc queries. Create a temporary file to test and verify small code snippets without affecting any shared project resources.
Configure run parameters In your Personal Directory, click the file to open it in the editor. In the Run Configuration panel on the right, set the following parameters:
Notebook files must be run in a Personal Development Environment. See Basic development in a Notebook for details.
Parameter Description Type The type of compute resource required to run the file Compute Resource A compute resource bound to the workspace Resource Group The resource group to use for this run Run and debug the code On the file details page, click the
icon in the toolbar to run the task.
Submit a file to the Project Directory
This method converts a file into a schedulable node, letting you configure it as a scheduled task and integrate it into a project workflow.
Start the submission In your Personal Directory, double-click the file to open it. In the toolbar, click the
icon to submit the file to the Project Directory.Configure submission parameters
Parameter Description Select node type The type of node to create. The system selects a default based on the file type: SQL file → MaxCompute SQL node, Notebook file → Notebook node, Python file → Python node, Shell file → Shell node. Select the path for the node The path for the node in the Project Directory. Confirm the node name Keep the original filename or enter a new name.
Submit a Python file as a resource or function
This method lets you reuse Python code across data development nodes. Register a .py file as a MaxCompute resource or function directly from your Personal Directory.
Start the submission In your Personal Directory, double-click the
.pyfile to open it. In the toolbar, click the dropdown menu next to the icon and select Submit As Function or Submit As Resource.Configure submission parameters
Parameter Description Type Submit As Function sets this to MaxCompute Function. Submit As Resource sets this toMaxCompute Python.Path The path in Resource Management. Defaults to the root directory ( /). To use a different path, first create the directory in Resource Management.Submission Type New: Creates a new function or resource. Enter a Name for it. Associate With Existing File: Links to an existing resource or function. Select the Existing Resource. When linking to an existing function, the current .pyfile replaces the function's Code. When linking to an existing resource, it replaces the resource's File Content.Click Confirm and follow the on-screen instructions. For parameter details, see MaxCompute resources and functions.
New: You are redirected to the creation page for the resource or function.
Associate With Existing File: You are redirected to the edit page for the existing item.