On the Overview of running status page, you can view the status information about specific sync solutions that is collected in a specified period of time. The information includes the status distribution of sync solutions, resource usage, status distribution of batch sync nodes and real-time sync nodes, synchronization rate, details of the synchronized data, and nodes with high latency. This helps you view the distribution and execution details of the nodes that are run and troubleshoot abnormal nodes. This way, the operations and maintenance (O&M) efficiency of sync nodes can be improved.

Go to the Overview of running status page

  1. Log on to the DataWorks console.
  2. In the left-side navigation pane, click Workspaces.
  3. In the top navigation bar, select the region where the target workspace resides. Find the target workspace and click Data Integration in the Actions column.
  4. In the left-side navigation pane, choose Sync Solutions > Overview of running status.

View the status information about sync solutions

You can view the status information about specific sync solutions that is collected in the specified period of time based on your business requirements.
  • You can view the status information that is collected within the last week, last 48 hours, or last 24 hours. By default, status information that is collected within the last 24 hours is displayed.
  • From the Task type drop-down list, you can select one or more of the following types: One-click batch synchronization to Elasticsearch, One-click real-time synchronization to Elasticsearch, One-click real-time synchronization to MaxCompute, and One-click real-time synchronization to Hologres. By default, all of the four types are selected.
On the Overview of running status page, you can view the status information in the following sections:
  • The Total operating state distribution section displays the total number and status distribution of sync solutions, the number of successful sync solutions, and the number of failed sync solutions. The statistics are collected in the specified period of time. You can click a sector in the pie chart to go to the solution list page. On this page, you can view the successful or failed sync solutions and the execution details of the sync solutions. For more information about the execution details of a sync solution, see View the execution details of a sync solution.
  • The Resource Group water level section displays the resource specifications and resource usage of the resource groups that are used by the current account. You can click the name of a resource group to go to the details page of the resource group. On the details page, you can view the basic information and resource usage of the resource group. For more information about resource groups, see View the resource usage of an exclusive resource group.Resource Group water level
  • The Synchronize subtasks offline section displays the number of batch sync nodes in specific sync solutions, synchronization rate, status distribution of the batch sync nodes, and details of the synchronized data. The statistics are collected in the specified period of time.
    Note The statistics in the Synchronize subtasks offline section are updated on an hourly basis.
    • The statistics about status distribution are the distribution and numbers of the successful and failed nodes.
    • The Synchronize data subsection includes the following items:
      • Number of synchronization tasks: displays the number of batch sync nodes that are successful.
      • Amount of data synchronized: displays the amount of data that is synchronized by batch sync nodes that are successful or running.
      • Number of synchronization records: displays the number of data records that are synchronized by batch sync nodes.
  • The Synchronize subtasks in real time section displays the number of real-time sync nodes in specific sync solutions, synchronization rate, status distribution of the real-time sync nodes, and top 10 nodes with the highest latency. You can click the name of a node to go to the O&M page and view the details of the node.

View the execution details of a sync solution

  1. In the left-side navigation pane of the Data Integration page, choose Sync Solutions > Nodes.
    On the Task list page, you can view the ID, type, name, description, creation time, status, and creator of each sync solution. You can also perform operations on each sync solution. You can filter the sync solutions based on different conditions. Nodes
  2. On the Task list page, find the sync solution whose execution details you want to view. In the Operation column, click More and select Execution details.
    On the Execution details page, you can view the following information:
    • The Basic Information section displays the information about the sync solution, such as the status and execution time. Basic Information
    • The Execution data section displays the statuses of the Environment preparation, Full Batch Sync, and Real-time Sync nodes. You can check whether the nodes are run as expected based on their status. This way, you can troubleshoot the issues of the sync solution at the earliest opportunity. A sync node can be in one of the following states:
      • If the Success icon is displayed, the node is successful.
      • If the Failed icon is displayed, the node failed.
      • If the Pending icon is displayed, the node waits to be run.
      Example 1: The following figure shows that the sync solution is successful. Execution succeeded
      Example 2: The following figure shows that the Environment preparation node failed. In this case, the Full Batch Sync and Real-time Sync nodes are blocked and can only wait for execution and the sync solution failed. You can troubleshoot issues for the sync solution based on the status of its nodes at the earliest opportunity. Execution failed
    • The Full Offline Synchronization section displays the information about the Full Batch Sync node in the sync solution. The information includes the data source, current synchronization rate, details of the synchronized data, and details of the resource group that is used in batch synchronization.
      • The Synchronize data subsection includes the following items:
        • Number of synchronization tasks: displays the number of batch sync nodes that are successful.
        • Amount of data synchronized: displays the amount of data that is synchronized by batch sync nodes that are successful or running.
        • Number of synchronization records: displays the number of data records that are synchronized by batch sync nodes.
      • For more information about resource groups, see View the resource usage of an exclusive resource group.
      Full Offline Synchronization
      To view the details of the resource group in this section, perform the following steps:
      1. Click the name of the resource group.
      2. In the Full offline synchronization details dialog box, click Details to go to the details page of the resource group. On the details page, view the basic information, resource usage, and resource usage trend of the resource group. Details of the resource group
    • The Real-time Synchronization section displays the information about the Real-time Sync node in the sync solution. The information includes the name of the real-time sync node, current synchronization rate, synchronization latency, and resource group that is used in real-time synchronization.For more information about resource groups, see View the resource usage of an exclusive resource group.Real-time synchronization
      To view the details of the resource group in this section, perform the following steps:
      1. Click the name of the resource group.
      2. In the Details of Real-time Synchronization dialog box, click Details to go to the details page of the resource group. On the details page, view the basic information, resource usage, and resource usage trend of the resource group. Details of the resource group
    • The Perform steps section displays all the steps in the sync solution from node creation to execution of batch sync nodes and real-time sync nodes. You can view the execution time and status of each step in this section. Perform stepsTo view the execution details of s step, perform the following steps:
      1. Find the step and click Execution details in the Status column.
      2. In the dialog box that appears, click the name of a node to view the details of the node.
        The following figure shows the details of the created log table in MaxCompute.View the details of the created log table in MaxCompute