After installing an ARMS agent for Python for a Large Language Model (LLM) application, Application Real-Time Monitoring Service (ARMS) will analyze the trace data of the application. You can view the time consumed by different types of spans in the traces of LLMs, as well as span information, such as input, output, and token consumption on the Trace Explorer tab of the application details page.
The LLM Trace Explorer feature is currently in beta testing. If you wish to experience this feature, please join the DingTalk group (ID: 67690017432) to get assistance.
Prerequisites
An ARMS agent has been installed for the LLM application.
Filter trace data
Log on to the ARMS console.
In the left-side navigation pane, choose .
On the Trace Explorer page, set the desired time range to query in the upper right corner.
NoteBy default, Trace Explorer uses the Large Model View (
icon). To switch to the Microservice View, click the 
icon.Filter trace data.
In the Quick Filter section, filter traces by status, duration, span type, interface name, or model name.
The specified filter conditions will appear in the search box at the top of the page.
Click the search box at the top. In the drop-down dialog box, modify existing filter conditions or add new ones.
Directly enter query conditions in the search box at the top. For information about the query syntax, see Usage methods of Trace Explorer.
NoteClick the
icon on the right side of the search box to save the current filter conditions.Click Saved View on the right side of the search box to view saved filter conditions. Click the desired filter condition to quickly view trace data under that condition.
Select aggregation dimensions to group the filtered data.
Trace list
After setting the filter conditions, the Trace Explorer page will show the filtered LLM trace data, including call count, tokens, duration percentiles, duration distribution, and the trace list.
The trace list displays details such as trace ID, input/output content, interface name, span type, duration, token count, application name, user ID, session ID, and start time. In the trace list, you can perform the following operations:
Locate the desired trace and click Details in the Actions column to view complete trace information. For more information, see Trace Details.
Locate the desired trace and click Logs in the Actions column to view the logs.
Click the
icon in the upper right corner to customize the fields displayed in the list.Hover over a field and click the
icon to add the current field value as a filter condition.
Trace details
On the Trace details tab of the panel that appears after clicking a trace or Details in the Actions column, you can view the timeline, start time, total duration, and details such as input/output content, span name, span type, span duration, application name, and token count.
On the Trace details tab, you can perform the following operations:
Hover over a token tag to view detailed token data.
Click a span name to view its duration, start time, additional information, metrics, and logs. Different operation types may display varying information.
Additional information includes the model name, input question, Prompt template, invocation parameters, and return results.
For information about Attributes fields, see Trace fields for LLM applications.
References
For information about other Trace Explorer features, see Trace Explorer.