Server-sent events for real-time speech recognition (Paraformer)_Alibaba Cloud Model Studio(Model Studio) - Alibaba Cloud Model Studio

Reference for the server-sent events that the Paraformer real-time speech recognition service pushes to clients over WebSocket. This topic documents the data structure and field semantics of the four event types: task-started, result-generated, task-finished, and task-failed.

User guide: For model details and selection guidance, see Speech-to-text.

Event interaction flow: For the event sequence diagram, see WebSocket API.

task-started

Description: The task has started successfully. The client can begin sending audio data.

headerobject

Properties

task_idstring

Client-generated task ID (UUID format).

eventstring

Event type. Always task-started.

attributesobject

Additional attributes. Typically empty.

payloadobject

Always {}.

{
    "header": {
        "task_id": "2bf83b9a-baeb-4fda-8d9a-xxxxxxxxxxxx",
        "event": "task-started",
        "attributes": {}
    },
    "payload": {}
}

result-generated

Description: Recognition result. Includes intermediate results (sentence_end=false) and final results (sentence_end=true).

headerobject

Properties

task_idstring

Client-generated task ID (UUID format).

eventstring

Event type. Always result-generated.

payloadobject

Properties

outputobject

Properties

usageobject

When payload.output.sentence.sentence_end is false (the current sentence has not ended), usage is null.

When payload.output.sentence.sentence_end is true (the current sentence has ended), usage.duration indicates the billable duration of the current task.

Properties

durationinteger

Billable task duration, in seconds.

Properties

sentenceobject

Properties

begin_timeinteger

Sentence start time, in milliseconds.

end_timeinteger

Sentence end time, in milliseconds.

textstring

Recognized text.

heartbeatboolean

If true, you can skip this result (heartbeat packet).

sentence_endboolean

Whether the sentence has ended (true=final result, false=intermediate result).

emo_tagstring

Important

Only paraformer-realtime-8k-v2 supports this feature.
This feature requires semantic segmentation to be disabled. Set semantic_punctuation_enabled to false in the run-task event.
The emotion recognition result is returned only when payload.output.sentence.sentence_end is true.

Sentiment of the current sentence:

positive: Positive sentiment, such as happy or satisfied.
negative: Negative sentiment, such as angry or dejected.
neutral: No distinct sentiment.

emo_confidencefloat

Important

Only paraformer-realtime-8k-v2 supports this feature.
This feature requires semantic segmentation to be disabled. Set semantic_punctuation_enabled to false in the run-task event.
The emotion recognition result is returned only when payload.output.sentence.sentence_end is true.

Emotion confidence score in the range [0.0, 1.0]. A higher value indicates greater confidence.

wordsarray[object]

Word-level timestamp information.

Properties

begin_timeinteger

Word start time, in milliseconds.

end_timeinteger

Word end time, in milliseconds.

textstring

Recognized text.

punctuationstring

Punctuation mark.

{
  "header": {
    "task_id": "2bf83b9a-baeb-4fda-8d9a-xxxxxxxxxxxx",
    "event": "result-generated",
    "attributes": {}
  },
  "payload": {
    "output": {
      "sentence": {
        "begin_time": 170,
        "end_time": null,
        "text": "Okay, I got it.",
        "heartbeat": false,
        "sentence_end": true,
        "words": [
          {
            "begin_time": 170,
            "end_time": 295,
            "text": "Okay",
            "punctuation": ","
          },
          {
            "begin_time": 295,
            "end_time": 503,
            "text": "I",
            "punctuation": ""
          },
          {
            "begin_time": 503,
            "end_time": 711,
            "text": "got",
            "punctuation": ""
          },
          {
            "begin_time": 711,
            "end_time": 920,
            "text": "it",
            "punctuation": ""
          }
        ]
      }
    },
    "usage": {
      "duration": 3
    }
  }
}

task-finished

Description: The task ended normally. You can close the connection or reuse it.

headerobject

Properties

task_idstring

Client-generated task ID (UUID format).

eventstring

Event type. Always task-finished.

attributesobject

Additional attributes. Typically empty.

payloadobject

The contents can be ignored. Typically {}.

{
    "header": {
        "task_id": "2bf83b9a-baeb-4fda-8d9a-xxxxxxxxxxxx",
        "event": "task-finished",
        "attributes": {}
    },
    "payload": {
        "output": {},
        "usage": null
    }
}

task-failed

Description: The task failed. The connection is closed and cannot be reused.

headerobject

Properties

task_idstring

Client-generated task ID (UUID format).

eventstring

Event type. Always task-failed.

error_codestring

Description of the error type.

error_messagestring

Specific cause of the error.

attributesobject

Additional attributes. Typically empty.

payloadobject

Always {}.

{
    "header": {
        "task_id": "2bf83b9a-baeb-4fda-8d9a-xxxxxxxxxxxx",
        "event": "task-failed",
        "error_code": "CLIENT_ERROR",
        "error_message": "request timeout after 23 seconds.",
        "attributes": {}
    },
    "payload": {}
}