Add titles and subtitles to a short video - Intelligent Media Services

You can configure the Timeline parameter of the SubmitMediaProducingJob API operation to add titles and subtitles to a short video. For more information, see Timeline configurations.

Usage notes

Intelligent production supports editing and compositing, effect rendering, and templates for live streams, VOD files, and material files from Object Storage Service (OSS). For more information, see Overview of intelligent production.
You can produce a video from one or more videos, audio files, images, and subtitle materials by configuring Timeline parameters and calling the SubmitMediaProducingJob operation.
A timeline is created when you add materials and configure effects to create a video. A timeline consists of tracks, materials, and effects. For more information, see Timeline configurations.
For more information about how to use the IMS SDK to edit audio and video files, see Get started.

Title + video + voice-over script + auto alignment + background music + black background

Effect

Timeline example

{
  "VideoTracks": [
    {
      "VideoTrackClips": [
        {
          "MediaURL": "https://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/food/f18.mp4",
          "ReferenceClipId": "clip0",
          "Effects": [
            {
              "Radius": 0.1,
              "Type": "Background",
              "SubType": "Blur"
            }
          ]
        },
        {
          "MediaURL": "https://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/food/f16.mp4",
          "ReferenceClipId": "clip1",
          "Effects": [
            {
              "Radius": 0.1,
              "Type": "Background",
              "SubType": "Blur"
            }
          ]
        },
        {
          "MediaURL": "https://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/food/f10.mp4",
          "ReferenceClipId": "clip2",
          "Effects": [
            {
              "Radius": 0.1,
              "Type": "Background",
              "SubType": "Blur"
            }
          ]
        },
        {
          "MediaURL": "https://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/food/f11.mp4",
          "ReferenceClipId": "clip3",
          "Effects": [
            {
              "Radius": 0.1,
              "Type": "Background",
              "SubType": "Blur"
            }
          ]
        },
        {
          "MediaURL": "https://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/food/f9.mp4",
          "ReferenceClipId": "clip4",
          "Effects": [
            {
              "Radius": 0.1,
              "Type": "Background",
              "SubType": "Blur"
            }
          ]
        },
        {
          "MediaURL": "https://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/food/f12.mp4",
          "ReferenceClipId": "clip5",
          "Effects": [
            {
              "Radius": 0.1,
              "Type": "Background",
              "SubType": "Blur"
            }
          ]
        },
        {
          "MediaURL": "https://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/food/f1.mp4",
          "ReferenceClipId": "clip6",
          "Effects": [
            {
              "Radius": 0.1,
              "Type": "Background",
              "SubType": "Blur"
            }
          ]
        }
      ]
    }
  ],
  "AudioTracks": [
    {
      "AudioTrackClips": [
        {
          "Type": "AI_TTS",
          "ClipId": "clip0",
          "Content": "People know how to describe life as a mixture of different flavors.",
          "Effects": [
            {
              "Type": "AI_ASR",
              "Alignment": "TopCenter",
              "FontSize": 55,
              "OutlineColour": "#000000",
              "FontColor": "#ffffff",
              "Y": 0.75,
              "Outline": 2,
              "AdaptMode": "AutoWrap",
              "TextWidth": 0.8,
              "Font": "Alibaba PuHuiTi"
            }
          ],
          "Voice": "zhichu"
        },
        {
          "Type": "AI_TTS",
          "ClipId": "clip1",
          "Content": "Flavors are connected to feelings and tastes of life deep in their hearts.",
          "Effects": [
            {
              "Type": "AI_ASR",
              "Alignment": "TopCenter",
              "FontSize": 55,
              "OutlineColour": "#000000",
              "FontColor": "#ffffff",
              "Y": 0.75,
              "Outline": 2,
              "AdaptMode": "AutoWrap",
              "TextWidth": 0.8,
              "Font": "Alibaba PuHuiTi"
            }
          ],
          "Voice": "zhichu"
        },
        {
          "Type": "AI_TTS",
          "ClipId": "clip2",
          "Content": "In this era,",
          "Effects": [
            {
              "Type": "AI_ASR",
              "Alignment": "TopCenter",
              "FontSize": 55,
              "OutlineColour": "#000000",
              "FontColor": "#ffffff",
              "Y": 0.75,
              "Outline": 2,
              "AdaptMode": "AutoWrap",
              "TextWidth": 0.8,
              "Font": "Alibaba PuHuiTi"
            }
          ],
          "Voice": "zhichu"
        },
        {
          "Type": "AI_TTS",
          "ClipId": "clip3",
          "Content": "everyone has experienced too much pain and joy.",
          "Effects": [
            {
              "Type": "AI_ASR",
              "Alignment": "TopCenter",
              "FontSize": 55,
              "OutlineColour": "#000000",
              "FontColor": "#ffffff",
              "Y": 0.75,
              "Outline": 2,
              "AdaptMode": "AutoWrap",
              "TextWidth": 0.8,
              "Font": "Alibaba PuHuiTi"
            }
          ],
          "Voice": "zhichu"
        },
        {
          "Type": "AI_TTS",
          "ClipId": "clip4",
          "Content": "People always bury bitterness in their hearts.",
          "Effects": [
            {
              "Type": "AI_ASR",
              "Alignment": "TopCenter",
              "FontSize": 55,
              "OutlineColour": "#000000",
              "FontColor": "#ffffff",
              "Y": 0.75,
              "Outline": 2,
              "AdaptMode": "AutoWrap",
              "TextWidth": 0.8,
              "Font": "Alibaba PuHuiTi"
            }
          ],
          "Voice": "zhichu"
        },
        {
          "Type": "AI_TTS",
          "ClipId": "clip5",
          "Content": "Turn happiness into food.",
          "Effects": [
            {
              "Type": "AI_ASR",
              "Alignment": "TopCenter",
              "FontSize": 55,
              "OutlineColour": "#000000",
              "FontColor": "#ffffff",
              "Y": 0.75,
              "Outline": 2,
              "AdaptMode": "AutoWrap",
              "TextWidth": 0.8,
              "Font": "Alibaba PuHuiTi"
            }
          ],
          "Voice": "zhichu"
        },
        {
          "Type": "AI_TTS",
          "ClipId": "clip6",
          "Content": "Present it on the table of four seasons.",
          "Effects": [
            {
              "Type": "AI_ASR",
              "Alignment": "TopCenter",
              "FontSize": 55,
              "OutlineColour": "#000000",
              "FontColor": "#ffffff",
              "Y": 0.75,
              "Outline": 2,
              "AdaptMode": "AutoWrap",
              "TextWidth": 0.8,
              "Font": "Alibaba PuHuiTi"
            }
          ],
          "Voice": "zhichu"
        }
      ]
    },
    {
      "AudioTrackClips": [
        {
          "MediaURL": "https://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/music/m2.wav"
        }
      ]
    }
  ],
  "SubtitleTracks": [
    {
      "SubtitleTrackClips": [
        {
          "Type": "Text",
          "Font": "HappyZcool-2016",
          "Content": "Tasty Bites",
          "FontSize": 80,
          "FontColor": "#ffffff",
          "Y": 0.15,
          "Alignment": "TopCenter",
          "EffectColorStyle": "CS0004-000005",
          "FontFace": {
            "Bold": true,
            "Italic": false,
            "Underline": false
          }
        }
      ]
    }
  ]
}

Title + video + voice-over script + background music + image background

Effect

Timeline example

{
    "VideoTracks": [
        {
            "VideoTrackClips": [
                {
                    "MediaURL": "https://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/food/f9.mp4",
                    "Effects": [
                        {
                            "Radius": 0.1,
                            "Type": "Background",
                            "SubType": "Blur"
                        },
                        {
                            "Type": "Clip",
                            "SubType": "RandomClip",
                            "ClipDuration": 2.986
                        }
                    ]
                },
                {
                    "MediaURL": "https://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/food/f15.mp4",
                    "Effects": [
                        {
                            "Radius": 0.1,
                            "Type": "Background",
                            "SubType": "Blur"
                        },
                        {
                            "Type": "Clip",
                            "SubType": "RandomClip",
                            "ClipDuration": 1.3789997
                        }
                    ]
                },
                {
                    "MediaURL": "https://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/food/f4.mp4",
                    "Effects": [
                        {
                            "Radius": 0.1,
                            "Type": "Background",
                            "SubType": "Blur"
                        },
                        {
                            "Type": "Clip",
                            "SubType": "RandomClip",
                            "ClipDuration": 2.5270004
                        }
                    ]
                },
                {
                    "MediaURL": "https://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/food/f12.mp4",
                    "Effects": [
                        {
                            "Radius": 0.1,
                            "Type": "Background",
                            "SubType": "Blur"
                        },
                        {
                            "Type": "Clip",
                            "SubType": "RandomClip",
                            "ClipDuration": 1.1490002
                        }
                    ]
                },
                {
                    "MediaURL": "https://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/food/f2.mp4",
                    "Effects": [
                        {
                            "Radius": 0.1,
                            "Type": "Background",
                            "SubType": "Blur"
                        },
                        {
                            "Type": "Clip",
                            "SubType": "RandomClip",
                            "ClipDuration": 3.6759996
                        }
                    ]
                },
                {
                    "MediaURL": "https://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/food/f10.mp4",
                    "Effects": [
                        {
                            "Radius": 0.1,
                            "Type": "Background",
                            "SubType": "Blur"
                        },
                        {
                            "Type": "Clip",
                            "SubType": "RandomClip",
                            "ClipDuration": 2.5270004
                        }
                    ]
                },
                {
                    "MediaURL": "https://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/food/f6.mp4",
                    "Effects": [
                        {
                            "Radius": 0.1,
                            "Type": "Background",
                            "SubType": "Blur"
                        },
                        {
                            "Type": "Clip",
                            "SubType": "RandomClip",
                            "ClipDuration": 1.8380003
                        }
                    ]
                },
                {
                    "MediaURL": "https://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/food/f14.mp4",
                    "Effects": [
                        {
                            "Radius": 0.1,
                            "Type": "Background",
                            "SubType": "Blur"
                        },
                        {
                            "Type": "Clip",
                            "SubType": "RandomClip",
                            "ClipDuration": 2.2979984
                        }
                    ]
                }
            ]
        }
    ],
    "AudioTracks": [
        {
            "AudioTrackClips": [
                {
                    "MediaURL": "https://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/food/food_speech.mp3"
                }
            ]
        },
        {
            "AudioTrackClips": [
                {
                    "MediaURL": "https://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/music/m1.wav"
                }
            ]
        }
    ],
    "SubtitleTracks": [
        {
            "SubtitleTrackClips": [
                {
                    "Type": "Text",
                    "Font": "HappyZcool-2016",
                    "Content": "Tasty Bites",
                    "FontSize": 80,
                    "FontColor": "#ffffff",
                    "Y": 0.15,
                    "Alignment": "TopCenter",
                    "EffectColorStyle": "CS0004-000005",
                    "FontFace": {
                        "Bold": true,
                        "Italic": false,
                        "Underline": false
                    }
                }
            ]
        },
        {
            "SubtitleTrackClips": [
                {
                    "TimelineIn": 0,
                    "TimelineOut": 2.986,
                    "OutlineColour": "#000000",
                    "FontColor": "#ffffff",
                    "Outline": 2,
                    "Font": "Alibaba PuHuiTi",
                    "Type": "Text",
                    "Alignment": "TopCenter",
                    "FontSize": 55,
                    "Content": "People know how to describe life as a mixture of different flavors.",
                    "Y": 0.75,
                    "AdaptMode": "AutoWrap",
                    "TextWidth": 0.8
                },
                {
                    "TimelineIn": 2.986,
                    "TimelineOut": 4.365,
                    "OutlineColour": "#000000",
                    "FontColor": "#ffffff",
                    "Outline": 2,
                    "Font": "Alibaba PuHuiTi",
                    "Type": "Text",
                    "Alignment": "TopCenter",
                    "FontSize": 55,
                    "Content": "This is because they know flavors.",
                    "Y": 0.75,
                    "AdaptMode": "AutoWrap",
                    "TextWidth": 0.8
                },
                {
                    "TimelineIn": 4.365,
                    "TimelineOut": 6.892,
                    "OutlineColour": "#000000",
                    "FontColor": "#ffffff",
                    "Outline": 2,
                    "Font": "Alibaba PuHuiTi",
                    "Type": "Text",
                    "Alignment": "TopCenter",
                    "FontSize": 55,
                    "Content": "Flavors are connected to feelings and tastes of life deep in their hearts.",
                    "Y": 0.75,
                    "AdaptMode": "AutoWrap",
                    "TextWidth": 0.8
                },
                {
                    "TimelineIn": 6.892,
                    "TimelineOut": 8.041,
                    "OutlineColour": "#000000",
                    "FontColor": "#ffffff",
                    "Outline": 2,
                    "Font": "Alibaba PuHuiTi",
                    "Type": "Text",
                    "Alignment": "TopCenter",
                    "FontSize": 55,
                    "Content": "In this era,",
                    "Y": 0.75,
                    "AdaptMode": "AutoWrap",
                    "TextWidth": 0.8
                },
                {
                    "TimelineIn": 8.041,
                    "TimelineOut": 11.717,
                    "OutlineColour": "#000000",
                    "FontColor": "#ffffff",
                    "Outline": 2,
                    "Font": "Alibaba PuHuiTi",
                    "Type": "Text",
                    "Alignment": "TopCenter",
                    "FontSize": 55,
                    "Content": "everyone has experienced too much pain and joy.",
                    "Y": 0.75,
                    "AdaptMode": "AutoWrap",
                    "TextWidth": 0.8
                },
                {
                    "TimelineIn": 11.717,
                    "TimelineOut": 14.244,
                    "OutlineColour": "#000000",
                    "FontColor": "#ffffff",
                    "Outline": 2,
                    "Font": "Alibaba PuHuiTi",
                    "Type": "Text",
                    "Alignment": "TopCenter",
                    "FontSize": 55,
                    "Content": "People always bury bitterness in their hearts.",
                    "Y": 0.75,
                    "AdaptMode": "AutoWrap",
                    "TextWidth": 0.8
                },
                {
                    "TimelineIn": 14.244,
                    "TimelineOut": 16.082,
                    "OutlineColour": "#000000",
                    "FontColor": "#ffffff",
                    "Outline": 2,
                    "Font": "Alibaba PuHuiTi",
                    "Type": "Text",
                    "Alignment": "TopCenter",
                    "FontSize": 55,
                    "Content": "Turn happiness into food.",
                    "Y": 0.75,
                    "AdaptMode": "AutoWrap",
                    "TextWidth": 0.8
                },
                {
                    "TimelineIn": 16.082,
                    "TimelineOut": 18.38,
                    "OutlineColour": "#000000",
                    "FontColor": "#ffffff",
                    "Outline": 2,
                    "Font": "Alibaba PuHuiTi",
                    "Type": "Text",
                    "Alignment": "TopCenter",
                    "FontSize": 55,
                    "Content": "Present it on the table of four seasons.",
                    "Y": 0.75,
                    "AdaptMode": "AutoWrap",
                    "TextWidth": 0.8
                }
            ]
        }
    ]
}

Title + video + music

Effect

Timeline example

{
  "VideoTracks": [{
    "VideoTrackClips": [{
      "MediaURL": "http://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/h1.mp4",
      "Out": 5,
      "Effects": [{
        "Type": "Volume",
        "Gain": 0
      }]
    },{
      "MediaURL": "http://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/h2.mp4",
      "Out": 5,
      "Effects": [{
        "Type": "Volume",
        "Gain": 0
      }]
    },{
      "MediaURL": "http://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/h3.mp4",
      "Out": 5,
      "Effects": [{
        "Type": "Volume",
        "Gain": 0
      }]
    }]
  }],
  "AudioTracks": [{
    "AudioTrackClips": [{
      "MediaUrl": "http://ice-document-materials.oss-cn-shanghai.aliyuncs.com/test_media/music/m1.wav",
      "Out": 15
    }]
  }]
}

Intelligent Media Services:Add titles and subtitles to a short video

Usage notes

Title + video + voice-over script + auto alignment + background music + black background

Title + video + voice-over script + background music + image background

Title + video + music

References