Configure log forwarding for DLC jobs - Platform For AI - Alibaba Cloud Documentation Center

By configuring log forwarding, you can send logs from Deep Learning Containers (DLC) jobs in your workspace to a specified Logstore in Simple Log Service (SLS) for custom analysis.

Prerequisites

If you use a RAM user to configure SLS log forwarding, you must grant the AliyunLogFullAccess permission to the RAM user. For more information, see Grant permissions to a RAM user.

Procedure

Go to your workspace.
1. In the top navigation bar, select a region.
2. In the left-side navigation pane, click Workspaces. On the Workspaces page, click the name of the workspace to manage.
In the upper-right corner of the workspace details page, click Configure Workspace and select Configure SLS from the drop-down list.

The log forwarding feature supports both user logs and system logs from DLC jobs. You can forward these logs to a custom Logstore in Simple Log Service (SLS) to facilitate end-to-end monitoring, operations, and diagnostics for training jobs based on system logs. On the Configure SLS page, set the following parameters and click OK.

Parameter	Description
SLSProject	A resource management unit in Simple Log Service used for resource isolation and control. If no projects are available, click Create SLS Project to create one. For more information, see Manage projects.
LogStore	A unit in Simple Log Service for collecting, storing, and querying log data. If no Logstores are available, click Create Logstore to create one. For more information, see Manage a Logstore.
Modules that require SLS storage	Select the Deep Learning Containers (DLC) checkbox.

FAQ

Q: No data shown in the SLS log list when configuring SLS log forwarding

Error: Unauthorized error — denied by sts or ram, action: log:ListProject, resource: acs:log.....

Cause: The user lacks permission to read the SLS log store.

Solution: Grant log store permissions to the user:

Log in to the RAM console. In the left navigation pane, go to Permission Management > Authorizations, then click Create Authorization.
Set the principal to the RAM user or RAM role, and select AliyunLogFullAccess as the policy.
For finer-grained SLS permission configuration, go to Log Service console, open the target project, click the More icon, select Permission Helper from the menu, and generate a custom RAM policy.

Q: Request fails when configuring SLS log forwarding

Error: Modify configuration failed [SLS] cannot init client for sis service: com.alibaba.pai.workspace.common.exception.ServiceExceptionV2: No Privilege error: {0}

Cause: The user lacks permission to enable or disable SLS log forwarding.

Solution: Log in to the RAM console and create a custom policy that grants log forwarding permissions.

Use the following policy. For instructions on creating a custom policy, see Create a custom policy:

{
    "Version": "1",
    "Statement": [
        {
            "Effect": "Allow",
            "Action": [
                "log:GetProductDataCollection",
                "log:CloseProductDataCollection",
                "log:OpenProductDataCollection"
            ],
            "Resource": "*"
        }
    ]
}

For more granular control, replace the Resource value with the specific resource ARN.