Install third-party packages for tasks running on exclusive resource groups for scheduling using O\&M Assistant. Use one-click installation for common packages or Shell commands for custom packages.
Prerequisites
Before you begin, ensure that you have:
The AliyunDataWorksFullAccess or ModifyResourceGroup RAM policy — see Product and console access control: RAM Policy
How it works
O&M Assistant installs packages directly on the exclusive resource group for scheduling. Once installed, every task running on that resource group can use the package — no per-task configuration required.
Because the installation is resource-group-wide, a version conflict or compatibility issue affects all tasks on the group. Test packages in a non-production resource group before deploying to production.
Choose an installation method
Pick the method based on whether the package is in the DataWorks preset list:
| Quick installation | Manual installation | |
|---|---|---|
| When to use | Package is in the DataWorks preset list | Package is not in the preset list |
| Command | Auto-generated by DataWorks | Custom Shell command you provide |
| pip support | Supported (DataWorks generates the command) | Not supported — use yum or other tools |
| Supported categories | Python 2, Python 3, Yum | Any package installable via Shell |
Python packages installed via O&M Assistant work only for Python nodes (PyODPS 2 or PyODPS 3) running on the resource group. For MaxCompute Python User-Defined Functions (UDFs), see UDF example: Use third-party packages in Python UDFs.
Access O\&M Assistant
Log on to the DataWorks console. In the top navigation bar, select the target region. In the left-side navigation pane, click Resource Group.
On the Exclusive Resource Groups tab, find the resource group for Data Scheduling, click the
icon next to the Resource Group, and select O\&M Assistant.
Install a third-party package
Create an installation command
On the O&M Assistant page, click Create Command and select an installation method.
Quick installation
Use this method for packages in the DataWorks preset list. DataWorks generates the Shell command automatically.
Parameters:
Parameter Description Command name A custom identifier for the command. Command type Select Quick Installation. Package to install Select the package and version. DataWorks includes common packages for Python 2, Python 3, and Yum — including aliyun-python-sdk-core, NumPy, and Pandas. See the interface for the full list. Generated Shell script DataWorks auto-generates the installation command. For example, selecting aliyun-python-sdk-core generates pip install aliyun-python-sdk-core.Timeout Maximum execution time in seconds. The command stops if it exceeds this limit. Manual installation
Use this method when the preset list does not include the package you need. Provide a custom Shell command.
Parameter Description Command name A custom identifier for the command. Command type Select Manual Installation. Command content The Shell command to run. Example: yum install -y git. Custom commands cannot usepip. Use absolute paths to reference packages, and test commands before running in production.Installation directories Directory paths the command can access. Separate multiple paths with semicolons ( ;). DataWorks adds these to a whitelist. Install to/home/or non-/home/directories. For/home/installations, use/home/admin/usertools/tools/. Default:/home/admin/usertools/tools/.Timeout Maximum execution time in seconds. The command stops if it exceeds this limit. Click OK to save the command.
You cannot modify existing commands after saving. To change a command, delete it and create a new one.
Run the installation command
On the O&M Assistant page, find the command and click Run command in the Actions column. The system generates a command execution record.
Verify the installation
In the command execution record, check Execution Status and Command Content. If the command fails, click View Result in the Actions column to review the logs.
After successful installation, the package is available to all tasks running on that resource group.
View the environment configuration
On the O&M Assistant page, click View Detailed Environment Configuration in the upper-left corner to see all installed packages, versions, and statuses for the current resource group.
Use installed packages in a task node
After installing a package, configure the task node to run on the same exclusive resource group.
New version of Data Studio
Go to the DataWorks Workspaces page, switch to the target region, find your workspace, and click Shortcuts > DataStudio.
In the task node, click Scheduling in the right pane. Set Resource Group to Exclusive Resource Group for Scheduling. > If the target resource group is not listed, go to the Resource Group page and click Associate Workspace.
In the Run Configuration pane, configure Computing Resource, Resource Group, and Script Parameters, then click Running Duration in the toolbar to debug the node.
Click Publish in the toolbar to deploy the node to production.
Legacy version of DataStudio
Log on to the DataWorks console, switch to the target region, click Data Development and O\&M > Data Development, select your workspace, and click Go to Data Development.
In the task node, click Properties in the right pane. Set Resource Group to Exclusive Resource Group for Scheduling. > If the target resource group is not listed, go to the Resource Group page and click Associate Workspace.
Click Run with Parameters (
), configure Resource Group Name, and click Run.Click Save and Submit to deploy the node to production.