This topic helps you quickly understand the best practices for two types of intelligent agents in AI real-time interaction.
Best practices for audio and video calls
Core capability | Best practice | Description |
Agent integration | Quickly test an agent without deploying a server. | |
Agent avatar animation | How to implement agent avatar animations | Customize agent avatar animations. |
Agent startup | How to initiate agent calls through server-side interfaces | How to initiate agent calls using server-side OpenAPI. |
Implement an agent that directly answers user questions without outputting a welcome message at startup. | ||
Call interruption prevention | How to prevent interruptions during agent announcements in calls | Use prompts to control large language model output to prevent the agent from being interrupted by users. |
Emotion detection | How to implement emotion detection and generation for agents | Implement emotion detection and generation for agents. |
Human takeover | How to implement human customer service takeover of an agent | Implement human customer service takeover of an agent. |
Chat history | Use conversation history to achieve more coherent, context-sensitive conversations. | |
How to implement data archiving | Implement user data archiving by obtaining text chat records or audio files. | |
Obtain audio PCM data by calling the AICallKit SDK. | ||
Parameter passing | Pass business parameters to Alibaba Cloud Model Studio large language model | Pass business parameters to the Alibaba Cloud Model Studio large language model. |
Server-side active sending | Input text as large language model (LLM) input content by calling interfaces. | |
How to actively send custom messages to clients. | ||
Actively input text for voice announcements. |
Best practices for message conversations
Core capability | Best practice | Description |
Chat history | Message conversation records filter interaction with audio and video call records. | |
Server-side active sending | How to actively send custom messages to clients. |