Alibaba Cloud Model Studio:Qwen-Audio-3.0-ASR-Flash-Streaming/Fun-ASR-Realtime real-time speech recognition client events

contextarray(object)(Optional)

The conversation context, which improves recognition accuracy for domain-specific vocabulary. For usage details, see Context enhancement.

formatstring(Required)

The audio format.

Valid values:

• pcm
• wav
• mp3
• opus
• speex
• aac
• amr

sample_rateinteger(Required)

The sample rate, in Hz.

Valid values: 8 kHz models support only 8000 Hz; other models support any sample rate.

vocabulary_idstring(Optional)

The ID of a precompiled hot word list.

Generate this ID in advance by calling the create hot word list API. Pass the ID during recognition to use the hot words in the list.

Suitable for scenarios where the vocabulary is known and relatively stable, and where you need to reuse the same word list across requests.

For usage details, see Precompiled hotwords.

vocabularyobject(Optional)

Instant hot words.

Passed as key-value pairs, where the key is the hot word text (string) and the value is the hot word weight (integer). No hot word list needs to be created in advance. The weight ranges from [1, 5] or is set to 50: a value in [1, 5] makes the model more likely to output the word as the value increases; a value of 50 designates a super hot word, which greatly improves recall, but the number of super hot words cannot exceed 50.

Suitable for temporary, session-level hot word optimization.

When configured together with precompiled hot words, only the instant hot words take effect. For usage details, see Instant hotwords.

language_hintsarray[string](Optional)

The language of the audio to recognize. There is no default value; if not set, the model detects the language automatically.

For the Qwen-Audio-3.0-ASR-Flash-Streaming model series, you can set up to 4 values; if you set more than 4, only the first 4 take effect. For the Fun-ASR-Realtime model series, you can set only 1 value; if you set multiple values, only the first one takes effect.

semantic_punctuation_enabledboolean(Optional)

Whether to enable semantic segmentation.

Default value: false.

• true: Enables semantic segmentation and disables VAD segmentation.
• false (default): Enables VAD segmentation and disables semantic segmentation.

Semantic segmentation is more accurate and is better suited to meeting transcription scenarios. VAD (Voice Activity Detection) segmentation has lower latency and is better suited to interactive scenarios.

max_sentence_silenceinteger(Optional)

The VAD silence threshold for segmentation, in ms. When the silence after a segment of speech exceeds this threshold, the system determines that the sentence has ended. When semantic_punctuation_enabled is set to true, this parameter is not used as the criterion for returning sentence_end, but setting it too low may affect recognition performance.

Default value: 1300.

Valid values: [200, 6000].

multi_threshold_mode_enabledboolean(Optional)

Whether to enable multi-threshold mode. When enabled, this prevents VAD segments from becoming too long.

Default value: false.

heartbeatboolean(Optional)

Whether to enable heartbeat packets.

Default value: false.

• true: Keeps the connection to the server alive even when silent audio is sent continuously.
• false (default): Even when silent audio is continuously sent, the connection times out and closes after a period of time.

Silent audio refers to content in an audio file or data stream that contains no sound signal. You can generate silent audio in several ways, such as using audio editing software like Audacity or Adobe Audition, or using a command-line tool like FFmpeg.

speech_noise_thresholdfloat(Optional)

The threshold for distinguishing speech from noise, used to adjust the sensitivity of Voice Activity Detection (VAD).

Valid values: [-1.0, 1.0].

Value descriptions:

• The closer the value is to -1: The noise threshold decreases, so noise is more likely to be recognized as speech, which may cause more noise to be transcribed.
• The closer the value is to +1: The noise threshold increases, so speech is more likely to be misjudged as noise, which may cause some speech to be filtered out.

This is an advanced configuration parameter. Adjusting it can significantly affect recognition results. Recommendations:

• Thoroughly test and verify the results before adjusting.
• Adjust in small increments based on the actual audio environment (a step of 0.1 is recommended).

special_word_filter string(Optional)

Specifies the sensitive words to process during speech recognition, and supports setting different processing methods for different sensitive words. For details, see Sensitive word filtering.

context _array(object)___ (Optional) The conversation context, which improves recognition accuracy for domain-specific vocabulary. For usage details, see Quick start.

Properties role _string_ __(Required) The message role. Valid values:

user: The recognition results from previous turns of user speech, or a domain-specific word list.

assistant: The responses from the large language model in previous turns.

content _array(object)___(Required) The list of message contents. Properties type _string_ __(Required) The content type. Valid values:

input_text: The recognition results from previous turns of user speech, or a domain-specific word list (used when role is user). You must also provide the text field.

text: The responses from the large language model in previous turns (used when role is assistant). You must also provide the text field.

text _string_ __(Required) The text content. When type is input_text, enter the recognition results from previous turns of user speech or a domain-specific word list. When type is text, enter the responses from the large language model in previous turns.