All Products
Search
Document Center

Simple Log Service:Manage a MaxCompute data shipping job (new version)

Last Updated:Dec 22, 2023

On the Data Shipping Overview page of a data shipping job that is used to ship data to MaxCompute, you can view the basic information and statistical reports of the job. You can also modify, restart, or delete the job.

Prerequisites

Procedure

  1. Log on to the Simple Log Service console.

  2. In the Projects section, click the project that you want to manage.

  3. In the left-side navigation pane, choose Job Management > Data Shipping.

  4. Click the MaxCompute data shipping job.

View the basic information about a data shipping job

In the Basic Information section, you can view the creation time, modification time, and source Logstore of the data shipping job.基础信息

View charts

After you create a data shipping job, Simple Log Service automatically creates a dashboard. You can view the metric data of the data shipping job on the dashboard.

Chart name

Description

Ingest Success

Displays the number of logs that are read from the source Logstore.

Ingest Failed

Displays the number of logs that failed to be read from the source Logstore.

Ingest PubNet (MB)

Displays the volume of traffic that is read over the Internet.

Deliver Success

Displays the number of logs that are shipped to MaxCompute.

Deliver Failed

Displays the number of logs that failed to be shipped to MaxCompute.

Deliver PubNet (MB)

Displays the volume of traffic that is written over the Internet.

Process Speed (events/s)

Displays the number of logs that are processed per second.

Process Lags

Displays the latency information of each shard in the Logstore.

Process Error

Displays the exceptions that occur when the data shipping job is running.

You can view complete error logs in the internal-diagnostic_log Logstore of a specific project based on the keyword ERROR or WARN. This project is the project that you specified when you enabled the job operational log feature. For more information, see Enable the service log feature.

Process State

Displays the status of the data shipping job. The information includes the shipping time, number of shipped logs, number of failed logs, and average response time.

Modify and restart a data shipping job

You can click Modify LogShipper to modify the settings of the data shipping job.

After you save the settings, Simple Log Service automatically restarts the job. The restart process requires a few seconds. You can click Refresh to check whether the restart is completed. After the job is restarted, make sure that the job starts to run and check whether data is shipped to MaxCompute as expected.

Note

You cannot change the name or start time of a data shipping job.

Delete a data shipping job

If you no longer need to run the data shipping job, choose Actions > Delete in the upper-right corner of the Data Shipping Overview page.

Warning

After you delete a data shipping job, the job cannot be restored. Proceed with caution.