Application Real-Time Monitoring Service (ARMS) can monitor your large language model (LLM) applications after you install an ARMS agent for Python. You can view the session list and details for the applications within a specified time period on the Conversation Analysis page.
Prerequisite
An ARMS agent is installed for your LLM applications. For more information, see Monitor LLM applications in ARMS.
Procedure
Log on to the ARMS console. In the left-side navigation pane, choose .
On the page that appears, select a region in the top navigation bar and click the application that you want to manage.
In the top navigation bar, click Conversation Analysis.
Click the search box on the top. In the drop-down menu, filter sessions based on the filter conditions, including session ID, user, session duration, number of traces, total tokens, input tokens, and output tokens.
Click a session name or click Details in the Actions column to view session details.
On the page that appears, click a trace ID to view trace details. For more information, see LLM Trace Explorer.
