Configure log forwarding for DLC jobs - Platform For AI - Alibaba Cloud Documentation Center

By configuring log forwarding, you can send logs from Deep Learning Containers (DLC) jobs in your workspace to a specified Logstore in Simple Log Service (SLS) for custom analysis.

Prerequisites

If you use a RAM user to configure SLS log forwarding, you must grant the AliyunLogFullAccess permission to the RAM user. For more information, see Grant permissions to a RAM user.

Procedure

Go to your workspace.
1. In the top navigation bar, select a region.
2. In the left-side navigation pane, click Workspaces. On the Workspaces page, click the name of the workspace to manage.
In the upper-right corner of the workspace details page, click Configure Workspace and select Configure SLS from the drop-down list.

The log forwarding feature supports both user logs and system logs from DLC jobs. You can forward these logs to a custom Logstore in Simple Log Service (SLS) to facilitate end-to-end monitoring, operations, and diagnostics for training jobs based on system logs. On the Configure SLS page, set the following parameters and click OK.

Parameter	Description
SLSProject	A resource management unit in Simple Log Service used for resource isolation and control. If no projects are available, click Create SLS Project to create one. For more information, see Manage projects.
LogStore	A unit in Simple Log Service for collecting, storing, and querying log data. If no Logstores are available, click Create Logstore to create one. For more information, see Manage a Logstore.
Modules that require SLS storage	Select the Deep Learning Containers (DLC) checkbox.

FAQ

Q: No data appears on the list page when configuring SLS log forwarding

Error message: Unauthorized error, with the message denied by sts or ram, action: log:ListProject, resource: acs:log......

Cause: The user does not have read permissions on the SLS Logstore.

Solution: Grant the user Logstore permissions by performing the following steps:

Log on to the RAM console. In the left-side navigation pane, choose Permissions > Grants, and then click Grant Permission.
Set the principal to the RAM user or RAM role, and select AliyunLogFullAccess as the authorization policy.
For finer-grained SLS permissions, go to the Log Service console, open the target project, click the More Applications icon, and then select Permission Assistant from the menu to generate a custom RAM policy.

Q: Request fails when configuring SLS log forwarding

Error message: Modify configuration failed [SLS] cannot init client for sis service: com.alibaba.pai.workspace.common.exception.ServiceExceptionV2: No Privilege error: {0}

Cause: The user does not have permissions to enable or disable SLS log forwarding.

Solution: Log on to the RAM console and configure a custom authorization policy to grant the user log forwarding permissions.

Configure the custom authorization policy as follows. For more information, see Create a custom policy:

{
    "Version": "1",
    "Statement": [
        {
            "Effect": "Allow",
            "Action": [
                "log:GetProductDataCollection",
                "log:CloseProductDataCollection",
                "log:OpenProductDataCollection"
            ],
            "Resource": "*"
        }
    ]
}

For more granular control, modify the Resource field to specify the target resources.