# Alibaba Cloud Model Studio - Training data summary

## Qwen and  Wan Training data summary <span id="48dbb9ae578rl" />

## Data sources <span id="h2_0d49a29e" />

Training data includes four categories:

- <strong>Publicly available internet data</strong> -- web content accessible to the general public.
- <strong>Third-party partner data</strong> -- non-public data provided by partners under agreement.
- <strong>Labeled and contracted data</strong> -- data from data-labeling services and paid contractors.
- <strong>Synthetic data</strong> -- data generated by proprietary Alibaba Cloud models to supplement real-world data.

Datasets may include copyrighted, trademarked, or patented content, as well as public domain content.

## Synthetic data <span id="h3_e86240df" />

Synthetic data generated by proprietary models addresses four needs:

- Fill gaps where real-world training data is limited
- Handle complex tasks that require specialized training examples
- Improve model generalization and perceptual performance
- Strengthen model safety and robustness

## Core capabilities <span id="h2_161b5af0" />

Training data builds these inference service capabilities:

- General language understanding
- Advanced reasoning
- Multimodal interaction
- Long-context processing
- Visual generation

Training data also supports task alignment, modality fusion, and capability refinement, enabling accurate and secure handling of diverse, specialized, and multimodal requests.

## Customer data policy <span id="h2_3dcf6460" />

Alibaba Cloud Model Studio does not use customer business data to develop or improve models without explicit consent.

## Data governance <span id="h2_62c7c1bb" />

A data governance framework covers the full training pipeline (pre-training through post-training) with measures for data cleaning, processing, and structural optimization.

## Pre-training <span id="h3_24fff250" />

Raw training data undergoes cleaning and filtering:

- <strong>Automated content safety screening</strong> removes harmful or sensitive content.
- <strong>Human review</strong> supplements automated filters as an additional safeguard.
- <strong>Personal information filtering</strong> reduces personal information in training datasets during preprocessing.

These measures help the model identify and reduce bias during inference, improving fairness and impartiality in outputs.

## Post-training <span id="h3_e29ff1da" />

## Language model data augmentation <span id="h4_520e0e0b" />

High-quality data is selected using a fine-grained annotation framework across five dimensions:

<table style={{ display: "table", tableLayout: "fixed", width: "100%" }}><colgroup><col style={{ width: "50%" }} /><col style={{ width: "50%" }} /></colgroup><thead><tr><th><p><span><strong>Dimension</strong></span></p></th><th><p><span><strong>Purpose</strong></span></p></th></tr></thead><tbody><tr><td><p>Educational value</p></td><td><p>Prioritize data with strong learning signals</p></td></tr><tr><td><p>Domain coverage</p></td><td><p>Cover breadth across knowledge areas</p></td></tr><tr><td><p>Language types</p></td><td><p>Support multilingual understanding</p></td></tr><tr><td><p>Reasoning complexity</p></td><td><p>Build advanced reasoning capabilities</p></td></tr><tr><td><p>Safety levels</p></td><td><p>Filter based on content safety criteria</p></td></tr></tbody></table>

Synthetic data from specialized models, including Qwen-Math and Qwen-Coder, further improves performance in multilingual understanding, complex reasoning, and long-context modeling.

## Visual generative model processing <span id="h4_086f6c3c" />

Multimodal data undergoes targeted preprocessing:

- <strong>High-precision OCR and document structural parsing</strong> for text extraction from images and documents
- <strong>2D/3D spatial semantic annotation</strong> for spatial understanding
- <strong>Explicit temporal alignment between video frames and text</strong> for video comprehension

Large-scale multimodal synthetic datasets strengthen cross-modal alignment between vision and language. They support complex document and long-form video understanding, and provide a training foundation for visual generation and agent-based interactions.

## Safety alignment <span id="h4_ce752a14" />

Dedicated safety datasets strengthen the model's built-in safety capabilities through safety alignment.

## Objective <span id="h3_20da1c23" />

These processes improve data quality and task alignment, maintain model safety and compliance, and achieve target performance across general-purpose, specialized, and multimodal inference.

## HappyHorse Training data summary <span id="0bfa5c899f72o" />

The HappyHorse model series in Alibaba Cloud Model Studio are self-developed models trained on datasets containing trillions of tokens across text, image, video, and audio.

### Data sources <span id="bebd18b3a0c73" />

Training data includes four categories:

- Publicly available internet data -- web content accessible to the general public.
- Third-party partner data -- non-public data provided by partners under agreement.
- Labeled and contracted data -- data from data-labeling services and paid contractors.
- Synthetic data -- data generated by proprietary Alibaba Cloud models to supplement real-world data.

Datasets may include copyrighted, trademarked, or patented content, as well as public domain content.

#### Synthetic data <span id="32ebe0252f70j" />

Synthetic data generated by proprietary models addresses four needs:

- Fill gaps where real-world training data is limited
- Handle complex tasks that require specialized training examples
- Improve model generalization and perceptual performance
- Strengthen model safety and robustness

### Core capabilities <span id="99131cd6d9vqh" />

Training data builds these inference service capabilities:

- General language understanding
- Advanced reasoning
- Multimodal interaction
- Long-context processing
- Visual generation

Training data also supports task alignment, modality fusion, and capability refinement, enabling accurate and secure handling of diverse, specialized, and multimodal requests.

### Customer data policy <span id="d99237d7e7z7z" />

Alibaba Cloud Model Studio does not use customer business data to develop or improve models without explicit consent.

### Data governance <span id="3685989c92z8u" />

A data governance framework covers the full training pipeline (pre-training through post-training) with measures for data cleaning, processing, and structural optimization.

#### Pre-training <span id="bd596aac65kho" />

Raw training data undergoes cleaning and filtering:

- Automated content safety screening removes harmful or sensitive content.
- Human review supplements automated filters as an additional safeguard.
- Personal information filtering reduces personal information in training datasets during preprocessing.

These measures help the model identify and reduce bias during inference, improving fairness and impartiality in outputs.

#### Post-training <span id="67d09e9b6ej1k" />

##### Language model data augmentation <span id="ac9f07c4581im" />

High-quality data is selected using a fine-grained annotation framework across five dimensions:

<table style={{ display: "table", tableLayout: "fixed", width: "100%" }}><colgroup><col style={{ width: "50.08%" }} /><col style={{ width: "49.92%" }} /></colgroup><thead><tr><th><p><strong>Dimension</strong></p></th><th><p><strong>Purpose</strong></p></th></tr></thead><tbody><tr><td><p>Educational value</p></td><td><p>Prioritize data with strong learning signals</p></td></tr><tr><td><p>Domain coverage</p></td><td><p>Cover breadth across knowledge areas</p></td></tr><tr><td><p>Language types</p></td><td><p>Support multilingual understanding</p></td></tr><tr><td><p>Reasoning complexity</p></td><td><p>Build advanced reasoning capabilities</p></td></tr><tr><td><p>Safety levels</p></td><td><p>Filter based on content safety criteria</p></td></tr></tbody></table>

Synthetic data from specialized models further improves performance in multilingual understanding, complex reasoning, and long-context modeling.

##### Visual generative model processing <span id="b6a4386c3e1ck" />

Multimodal data undergoes targeted preprocessing:

- High-precision OCR
- 2D/3D spatial semantic annotation for spatial understanding
- Explicit temporal alignment between video frames and text for video comprehension

Large-scale multimodal synthetic datasets strengthen cross-modal alignment between vision and language. They support long-form video understanding, and provide a training foundation for visual generation.

##### Safety alignment <span id="323f0e5754jit" />

Dedicated safety datasets strengthen the model's built-in safety capabilities through safety alignment.

#### Objective <span id="b0e0b1fdf20fd" />

These processes improve data quality and task alignment, maintain model safety and compliance, and achieve target performance across general-purpose, specialized, and multimodal inference.