All Products
Search
Document Center

Check test report details

Last Updated: Mar 16, 2022

Overview

Test report details

Step 1: Click each tab to view relevant content.

Tab

Description

Overview

Shows Execution Results, Error Logs, and Use Case Set Overview of the current test.

Device Details

Views or edits the execution results of test cases and related logs based on each test device.

Error Logs

Shows the error messages of the current test, including Crashes, Stucks, and Negligible Exceptions.

Performance Report

Shows the app performance statistics for the current test and each test device based on the performance data.

All Screenshots

Shows the major screenshots of the current test.

Step 2: Click each button in the upper-right corner to perform operations.

Button

Description

Download

Downloads the current test report.

Share

Generates the shared URL of the current test report. You can view the test report in a browser by using the shared URL.

Step 3: Move the pointer over the Help icon to view the basic information of the current test.

Functional Testing

Overview

On the Overview tab, view the Execution Results, Error Logs, and Use Case Set Overview of the test.

Execution Results

This section shows the number and the proportions of models by execution results. The execution results types include Passed, Failed, and Abnormal/Not Executed.

Execution Results

Error Logs

This section shows the list of critical errors.

Error Logs

Click View All or View Details to view all errors and their log details on the Error Logs tab. For more information, see Error logs.

Use Case Set Overview

The test results of the app are displayed based on each use case set.

Use Case Set Overview

Step 1: In the use case set list, click Use Case Overview in the Actions column. The details of the use case set cases are displayed.

Use Case Overview

Step 2: Click Model Overview in the Actions column corresponding to each test device to show the test results.

Model Overview

Step 3: In the Model Overview list, click Execution Logs corresponding to a device to view the execution logs of the device. Click Device Details to view detailed information of the device on the Device Details tab. For more information, see Device details.

Device Details

On the Device Details tab, perform the following operations:

Step 1: In the left-side Device list, click Filter to filter devices by Classification Method or Status.

Filter condition

Description

Classification Method

Groups test devices based on the specified classification method, including By Test Result, By System Version, and By Brand.

Status

Filters test devices in the specified state, including All, Failed, Device Error, Abnormal/Not Executed, Timed Out, Passed, Pending, and Running.

When Status is set to Failed, you can set Failure Part to Installation, Start, Running, or Uninstallation to further filter test devices.

Step 2: In the left-side Devices list, click the name of a device to view its details on the right side of the page.Device Details

Execution status

This section shows the execution status of each use case set for a specified device.

Execution status

If the specified device fails the test, click Remote Device Testing to apply for the same model and verify the test result.

Use Case Set Execution Overview

Step 1: In the View Use Case Set Execution Results drop-down list, select a use case set to view the execution overview of the specified use case set.

Step 2: Click Videos to view the execution video records of the specified use case set. Click Script Logs, Appium Logs, or Device Logs to view or download the corresponding execution logs of the specified use case set.

Use Case Set Execution Overview

Exception Summary

This section shows the exception information of the specified use case set.

Exception summary of intelligent exploration

In the Exception Summary list, click Details in the Actions column corresponding to an error to expand the details of the error, including error logs, problem analysis, and solutions.

Performance Analysis Curve

This section shows the trends of CPU utilization, memory usage, network usage, frame loss rate, and power consumption over time during the operation of the specified use case set.

Performance Analysis Curve

Move the pointer over the time trend chart to view the real-time value of each statistical item.

Error Logs

On the Error Logs tab, perform the following operations:

Step 1: Click the Crashes, Stucks, and Negligible Exceptions tabs to view the error logs.

Step 2: By default, part of an error log is displayed. Click the Expand icon to view the complete log.

Step 3: Click Download Error Logs to download specified error logs.

Step 4: Click Devices to view the device that causes the error.

Error Logs

Performance Report

On the Performance Report tab, view the Performance Overview and Model Performance sections.

Parameter

Description

Performance Overview

Provides an overview of the collected performance data.

Model Performance

Shows the collected performance data by device.

Performance Report

In the Model Performance section, click View Details in the Actions column corresponding to a device to view the details of the device. For more information, see Device details.

If the test result is not as expected or other exceptions occur, click Report Error in the Actions column. In the Test Task Error Reporting dialog box, specify and submit the relevant information.

Test Task Error Reporting

All Screenshots

All Screenshots

On the All Screenshots tab, perform the following operations:

Step 1: Click Filter, set Classification Method, and then view the screenshots of the specified category.

Step 2: Click the Large Image or Small Image icon on the right side of the page to show the screenshots in the specified image format.