After you install a Python agent for your Large Language Model (LLM) application, the LLM Trace Explorer feature analyzes the application's trace information. On the LLM Trace Explorer page, you can view the duration of different types of spans within a trace, along with related span information such as input, output, and token count.
The LLM Trace Explorer feature is currently in beta. To try this feature, join the DingTalk group (ID: 67690017432) for assistance.
Prerequisites
You have installed an agent for your LLM application. For instructions, see Integrate LLM applications and inference services with ARMS.
Filter traces
Log on to the ARMS console.
In the left-side navigation pane, choose LLM Application Monitoring > Trace Explorer.
On the Trace Explorer page, use the time picker in the upper-right corner to set the time range for your query.
NoteBy default, LLM applications are displayed in the Large Language Model view (
icon). To switch to the microservice view, click the 
icon.Filter traces.
In the Quick Filter area on the left, filter traces by status, duration, span type, interface name, or model name.
The filter conditions are displayed in the text box at the top of the page.
Click the text box at the top to modify existing filter conditions or set conditions for other dimensions in the drop-down panel.
Common query conditions include serviceName (application name), spanName (interface name), ip (host address), traceId (trace ID), and duration. You can select Only show traces with code hotspots, Only show root spans, Only show slow spans, or Only show error spans to filter results. Advanced queries support filtering by kind (endpoint type) and statusCode (status). You can also click Add query condition to add conditions based on attributes or resources. To apply the filters, click Query.
Enter query conditions directly in the text box at the top. For details on the query syntax, see Query syntax for Trace Explorer.
NoteClick the
icon to the right of the text box to save the current filter conditions.Click Saved View to the right of the text box to view your saved filter conditions. Click a filter condition to quickly view the corresponding trace information.
Select an aggregation dimension to group the filtered data.
Trace list
After configuring the filters, the Trace Explorer page displays filtered LLM trace information, including the call count, token count, duration percentiles, duration distribution, and the trace list.
Above the trace list, you can switch between different views by clicking tabs such as List, scatter plot, cross-trace aggregation, cross-trace topology, and slow and error traces. The slow trace analysis panel on the right ranks contributors to the longest trace by dimensions such as spanName, serviceName, and ip.
The trace list displays the trace ID, input and output content, interface name, span type, duration, token count, application name, user ID, session ID, and start time for each trace. In the trace list area, you can perform the following actions:
In the Actions column for a trace, click Details to view its complete details. For more information, see trace details.
In the Actions column for a trace, click Log to view the corresponding logs.
Click the
icon in the upper-right corner to add or hide columns in the list.Hover over a trace parameter and click the
icon on the right to add the current parameter value as a filter condition.
Trace details
In the trace details panel, you can view a trace's timeline, start time, and total duration, along with information such as input and output content, span name, type, application name, token count, and duration.
In the trace details panel, you can perform the following actions:
Hover over the token count tag to view detailed token data.
Click a span name to view its duration, start time, additional information, metrics, and logs. The information displayed varies by operation type.
The additional information includes the model name, input query, prompt template, invocation parameters, and results.
For descriptions of the attribute fields, see Field definitions for LLM traces.
Related documents
For details on other features of LLM Trace Explorer, see LLM Trace Explorer.