Dataphin:Instance run diagnosis

Limitations

• Run diagnosis is available only for offline recurring instances and backfill instances, including script, detail and summary table, and extraction instances. It does not support real-time instances (including real-time computing and real-time integration) or manual instances.

• For detail and summary table instances, analysis is available only at the materialized node level, not at the field level.

Overview

In O&M, different colors and icons represent each stage of the run process. The following table lists the instance running status values and the overall run process:

An instance runs successfully only when its upstream dependencies complete, the scheduled time is reached, sufficient resources are available, and execution itself succeeds. When an instance fails or stays in a single running status for an extended period, use run diagnosis to check the following items:

Accessing run diagnosis

1. In the top menu bar of the Dataphin homepage, choose Develop > O&M.

2. In the navigation pane on the left, choose Instance O&M > Recurring Instance, Backfill Instance, or Manual Instance.

3. On the Recurring Instance, Backfill Instance, or Manual Instance page, click the name of the target instance. Below the DAG on the right, click View Node Details.

   The following figure uses the Recurring Instance page as an example.

4. On the node details page, click the Run Diagnosis tab.

Upstream dependency

The upstream dependency diagnosis shows the result from the instance's last run and the current status of its upstream instances. The current instance proceeds to the next check only after all upstream instances complete. Use the diagnosis result to investigate failures. An instance that already passed the upstream dependency diagnosis in its last run is not re-diagnosed. To refresh the result, click the Refresh icon.

• If the last run of the instance succeeded and it was not a forced rerun, the diagnosis result is Passed.

  Feature	Description
  Last run	Shows the running status and completion time of the last run. Note An instance is scheduled only after all its upstream dependencies have been satisfied.
  Current diagnosis result	Shows the diagnosis result. Scheduling Type: Includes dry run, Normal Run, and suspended running. If the current instance's scheduling type is suspended running, you must resume scheduling for it to run. root blocking node: Shows the highest-level node in the dependency chain that is preventing the current node from running. Instances that have passed the upstream diagnosis do not have a root blocking node. Direct Upstream List: Lists the direct upstream dependencies. Search by node name, node ID, or instance ID, and filter by running status or owner.

• If an instance has not started running and its scheduling is not suspended, the scheduling type in the diagnosis result is Normal Run. Focus on the root blocking node as prompted. Resolving the blocking node's issue allows the current node to run. The current instance is scheduled only after all upstream instances run successfully.

• If the instance is currently in a suspended running state, the diagnosis stops, and the result is suspended running.

• A forced rerun bypasses the upstream dependency check. If the instance's last run was a forced rerun, the diagnosis result is Skipped.

Scheduled time

This check determines whether the instance has reached its scheduled time. The result displayed is for the most recent run. An instance is scheduled for execution only after its scheduled time is reached; otherwise, it stays in the Waiting for Scheduled Time state. To refresh the diagnosis result, click the Refresh icon.

• If the instance has not yet reached its scheduled time and its scheduling is not suspended, the diagnosis result is Waiting for Scheduled Time. To run the instance earlier, perform a forced rerun after confirming it will not affect downstream data quality.

• If the instance is in a suspended running state because its scheduling is suspended, the diagnosis result is Suspended. To run it, click resume scheduling.

• If the instance reached its scheduled time in its last run and it was not a forced rerun, the diagnosis result is Passed.

• A forced rerun bypasses the scheduled time check and starts immediately. If the last run of the instance was a forced rerun, the diagnosis result is Skipped.

Throttling rule

If you have purchased the intelligent O&M add-on feature, you can configure throttling rules. For instructions, see Throttling Configuration.

All instances are checked against throttling rules. After passing the upstream dependency and scheduled time checks, an instance must satisfy all matching throttling rules before being dispatched to the resource scheduling system. To refresh the diagnosis result, click the Refresh icon.

• If the instance's last run passed the upstream dependency and scheduled time checks and also satisfied all matching throttling rules, the diagnosis result is Passed.

• If the instance is currently being throttled while waiting to be dispatched and its scheduling is not suspended, the diagnosis result is Throttling. The duration it has been waiting is also displayed.

  Item	Description
  Blocking rule	Shows the name of the throttling rule triggered by the current instance. Click the rule name to view its details.
  Dispatched instance list	Lists the instances already dispatched in the queue of the triggered throttling rule. Search or filter dispatched instances by name or ID.

• If the instance is in a suspended running state because its scheduling is suspended, the diagnosis result is Suspended. Resume the instance's run state before it can be dispatched for resource scheduling.

Scheduling resource

Instances using shared running resources are generally less affected by scheduling resource availability. However, instances using dedicated resources must wait for sufficient idle resources in their assigned resource group before they can be scheduled; otherwise, their status is Waiting for Scheduling Resources. To refresh the diagnosis result, click the Refresh icon.

• If sufficient allocatable idle resources were available in the instance's resource group during its last run, and its scheduling is not suspended, the diagnosis result is Passed.

• If there are not enough idle scheduling resources for the current instance, the diagnosis result is Waiting for Scheduling Resources. The scheduling resource diagnosis page shows the Resource wait time, a diagnostic Suggestion, and a list of Resource occupying instances. Act on the suggestions and use the list to free up resources for the current instance.

Instance execution

Only instances that have reached the execution stage appear on the Instance Execution diagnosis page. This page displays the Run result and run log. If the Run result is Failed, use the run log to troubleshoot the issue. To refresh the diagnosis result, click the Refresh icon.

Click Open Run Log to navigate to the Run Log page. The run log contains error messages, performance diagnostics, and error codes. For more information about performance diagnostics, see Diagnose offline integration task performance.