Data Accelerator for Disaggregated Infrastructure (DADI) is an image acceleration capability provided by Alibaba Cloud Container Registry. Compared with the traditional layered tar file format, the OverlayBD image format implements network-based on-demand reading so containers can start quickly. Platform for AI (PAI) integrates with DADI. You can use DADI images in Data Science Workshop (DSW) or Deep Learning Containers (DLC) to accelerate model training. This topic describes how to use DADI images in DSW and DLC.
Prerequisites
PAI is activated and a workspace is created. For more information, see Activate PAI and create the default workspace.
The Container Registry service is activated.
A Container Registry Enterprise Edition instance is created. For more information, see Create a Container Registry Enterprise Edition instance.
NoteThe Container Registry Enterprise Edition instance must be of Advanced Edition.
The virtual private cloud (VPC) of the ACK cluster or ACK Serverless cluster is configured for the Container Registry Enterprise Edition instance. Accelerated image must be used in VPCs. For more information, see Configure a VPC ACL.
Enable image acceleration
You can enable image acceleration for a repository. This way, each image that is pushed to the repository is automatically converted to an accelerated image. The time required to convert a pushed image to an accelerated image depends on the size of the pushed image. The conversion does not affect the original image.
The accelerated image resides in the same namespace and repository as the original image. The tag of the accelerated image is the tag of the original image suffixed with _accelerated.
Log on to the Container Registry console.
In the top navigation bar, select a region.
In the left-side navigation pane, click Instances.
On the Instances page, click the Enterprise Edition instance that you want to manage.
In the left-side navigation pane of the management page of the Container Registry Enterprise Edition instance, choose .
On the Repositories page, find the repository for which you want to enable image acceleration. Click the name of the repository or click Manage in the Actions column.
On the page that appears, click Edit in the upper-left corner.
In the Modify Settings dialog box, select Enable for the Accelerated Image parameter and click Confirm.
After you enable image acceleration for the repository, each image that the system pushes to the repository is automatically converted to an accelerated image. If you want to be notified every time an image is converted to an accelerated image, you can specify an expression-based trigger for the repository. For example, you can specify
_accelerated$as the expression. For more information, see Manage triggers.
Use accelerated images in DLC or DSW
After the image is converted to an accelerated image, the namespace and repository name of the accelerated image are the same as those of the original image. The tag is the original image tag suffixed with _accelerated. You can use the accelerated image as a custom image in DLC or DSW.
Use an accelerated image to create a DLC job
Create a DLC job in the workspace. The following section describes key parameters. For more information about other parameters, see Create a training job.
Node Image: Select Image Address and configure the accelerated image address in the input box. The accelerated image address is the original image URL suffixed with
_accelerated.VPC: If you select Public Resource Group, you need to configure Virtual Private Cloud (VPC). Select the VPC network that is referenced in the Container Registry Enterprise Edition instance.
Use an accelerated image to create a DSW instance
Create a DSW instance in the workspace. The following section describes key parameters. For more information about other parameters, see Create and manage DSW instances.
Select Image: Click Image URL and configure the accelerated image address. The accelerated image address is the original image URL suffixed with
_accelerated.Networking: If you set Resource Quota to Public Resource Group, you need to configure the network. Select the VPC network that is referenced in the Container Registry Enterprise Edition instance.
References
For more information about DLC or DSW, see: