All Products
Search
Document Center

Realtime Compute for Apache Flink:View the exception logs of a deployment

Last Updated:Aug 01, 2023

If an error occurs when a deployment starts or is running, you can view the exception logs of the deployment in the console of fully managed Flink. This topic describes how to view the exception logs of a deployment, including logs of JobManager exceptions, logs of failed TaskManagers, and logs of the TaskManagers on which checkpoints are created at a low speed.

Background Information

Type

Description

Logs of JobManager exceptions

If a deployment fails to run due to a deployment failover, you must check whether a JobManager exception occurs. For more information about how to view the logs of JobManager exceptions, see View the logs of JobManager exceptions.

Note

If the JobManager of the deployment fails to start, the issue is not caused by a JobManager exception. In this case, you can view the startup logs to locate the issue.

Logs of failed TaskManagers

If a deployment runs as expected, no TaskManagers fail. However, if a deployment runs at a high risk level, one or more TaskManagers may fail and then run again. If a TaskManager fails, you can view the logs of the TaskManager to locate the issue. For more information about how to view the logs of failed TaskManagers, see View the logs of failed TaskManagers.

Note

You can view the logs of failed TaskManagers only when the Allow Log Archives switch in the Logging section is turned on. You can view the logs of failed TaskManagers within the retention period that is configured in the Logging section.

Logs of the TaskManagers on which checkpoints are created at a low speed

If one or more checkpoints are created at a low speed when a deployment is running, you can view the logs of the TaskManagers on which the checkpoints are created to locate the issue. For more information about how to view the logs of the TaskManagers on which the checkpoints are created at a low speed, see Find the checkpoints that are created at a low speed and view the logs of the TaskManagers for the checkpoints.

Prerequisites

The job that you want to manage is in the RUNNING state.

Precautions

Logs are displayed by page. Each page can display up to 1 MB of logs and approximately 8,000 to 9,000 rows of logs. In most cases, you can locate an issue based on the logs that are displayed on the first page. If you cannot locate the issue based on the logs that are displayed on the first page, go to the next page.

View the logs of JobManager exceptions

  1. Log on to the Realtime Compute for Apache Flink console.

  2. On the Fully Managed Flink tab, find the workspace that you want to manage and click Console in the Actions column.

  3. In the left-side navigation pane, click Deployments. On the Deployments page, click the name of the desired deployment.

  4. On the right side of the Deployments page, click the Logs tab. On the left side of the Logs tab, click the JM Exceptions tab to view the exception information about the JobManager.

    405996-1.png
    Note

    In the Exception History section, you can view the logs of the JobManager exceptions of the deployment within seven days. You can also specify an exception type to view the historical logs of the related JobManager exceptions of the deployment.

View the logs of failed TaskManagers

  1. Log on to the Realtime Compute for Apache Flink console.

  2. On the Fully Managed Flink tab, find the workspace that you want to manage and click Console in the Actions column.

  3. In the left-side navigation pane, click Deployments. On the Deployments page, click the name of the desired deployment.

  4. On the right side of the Deployments page, click the Logs tab. On the left side of the Logs tab, click the Running Logs tab. Then, select a job that is running from the Selected Job drop-down list.

    405996-2.png
  5. Click the Failed Task Managers tab.

Find the checkpoints that are created at a low speed and view the logs of the TaskManagers for the checkpoints

  1. Log on to the Realtime Compute for Apache Flink console.

  2. On the Fully Managed Flink tab, find the workspace that you want to manage and click Console in the Actions column.

  3. In the left-side navigation pane, click Deployments. On the Deployments page, click the name of the desired deployment.

  4. Find the checkpoints that are created at a low speed and view the logs of the TaskManagers for the checkpoints.

    1. On the right side of the Deployments page, click the Logs tab. On the Logs tab, click the Checkpoints tab.

    2. Find the checkpoints that are created at a low speed based on the values in the End to End Duration column.

      Checkpoint ID
    3. Click the 加号 icon on the left of the ID of a checkpoint that is created at a low speed to view the operator to which the checkpoint belongs.

    4. Click the 加号 icon on the left of the name of the operator to view the details about each subtask of the operator.

    5. Click the ID of the task node to which the checkpoint belongs.

      Task节点
    6. On the Running Task Managers tab of the page that appears, view the logs of the TaskManager on which the checkpoint is created at a low speed.