Intelligent Media Services:Online editing

Create a video editing project

Intelligent Cloud Editor provides live stream editing and recording file editing services. You can edit and output video content in real time during a live stream.

1. Click the Video Editing Project tab.

2. Click Create Editing Project, enter a project name, and then click OK.

3. In the Operation column of the created project, click Edit to open the standard editing project page.

Create a live stream editing project

1. Click the Live Stream Editing Project tab.

2. Click Create Live Stream Editing, configure the parameters for the live stream editing project, and then click OK.

   

   Parameter	Description
   Live Stream Editing Name	A custom name for the live stream editing project. The name can contain only letters, digits, spaces, and underscores (_). The name can be up to 60 characters long.
   Live Stream URL	Enter the URL of the Alibaba Cloud live stream that you want to edit. For more information about how to obtain a live stream URL, see Generate ingest and streaming URLs. Currently, only the HTTP Live Streaming (HLS) protocol is supported, which means m3u8 live streams over HTTPS. Note You can edit a live stream only after you enable live stream recording. For more information, see Record and store to OSS and Record and store to VOD.
   Storage Method	Configure how the generated live stream clips are stored. You can store them in Object Storage Service (OSS) or ApsaraVideo VOD.
   Storage Address	You can add ApsaraVideo VOD buckets and your own OSS buckets that are added to the ApsaraVideo VOD system. If no buckets are available, you can create a new bucket in the ApsaraVideo VOD console. The ApsaraVideo VOD system assigns a storage address to each storage region. After you activate ApsaraVideo VOD, you must enable this address before you can use it. For more information, see Manage storage buckets. You can add Object Storage Service (OSS) buckets. If no buckets are available, you can create a new bucket in the OSS console. For more information, see Create buckets.
   Start Time	Select a start time for the live stream editing. You can choose to Start Now or Start At Scheduled Time. Before the live stream starts, you can modify the schedule in the online editing list. After the live stream starts, recording begins automatically, and you can edit the stream in real time.

3. In the Operation column of the created project, click View to open the live stream editing project page. For more information about live stream editing, see Editing features.

Create an advanced template editing project

1. Click the Advanced Template Editing Project tab.

2. Click Create Editing Project, and then click OK as prompted to open the Advanced Templates page.

3. In the Operation column of the advanced template, click Use Template. Enter a project name and click OK to open the advanced template editing project page. For more information about advanced template editing, see Editing features.

Video editing

1. Open the video editing project page.

   

   The video editing page consists of the following areas:

   Number	Description
   ①	Asset area
   ②	Preview area
   ③	Property editing area
   ④	Editing operation area

2. Import assets.

   In the upper-right corner of the asset area, click Import Assets to open the media library for the current region. Then, select the required assets.

   

   If the media library does not contain the assets you need, you can upload them. For more information, see Upload media assets in the console.

3. Add assets to the editing operation area.

   Click the icon on an asset or drag the asset to a track in the editing operation area.

   

   You can also add public resources such as Stickers, Filters, and Effects to create multi-track assets and preview the results in real time.

4. Edit assets.

   • Crop, preview, or adjust asset properties

     Select an asset on a track in the editing operation area. You can use the tools in the upper-left corner of this area to crop or delete the video. In the preview area, you can preview, drag, scale, and position the asset. In the property editing area, you can adjust the asset properties.

     

   • Add transitions

     Select the video or image on the timeline to which you want to add a transition. In the asset area, click the Transitions tab. Select a transition, such as Swirl, and then view the effect in the preview area.

     

   • Auto-generate captions

     Select the video for which you want to generate captions. In the property editing area, click the Basic tab and then click Auto-generate Captions. The generated captions are automatically added to a new track.

     

   • Display the audio waveform for a video

     Select a video in the editing operation area. Click the icon and select the type of waveform to display. The waveform appears below the video on the track.

     

   • Auto-generate voiceover

     Select the captions for which you want to generate a voiceover. Click the icon to set the voice type, and then click Auto-generate Voiceover. The generated voiceover is automatically added to a new track.

     

     Note

     If the message 'Please Configure A Storage Path First' is displayed, you must configure a storage path. For more information, see Configure a storage address.

   • Add markers or marked segments

     Select a video in the editing operation area. Drag the timeline to a specific position. Click the icon to add a marker. Click the or icons to add the in and out points of a marked segment. You can also click the and icons, or click the markers and marked segments above the video on the track to view their details.

     

   • Separate the audio track from a video

     Select a video in the editing operation area. In the property editing area, click the Basic tab and then click Separate Audio Track. The separated audio track is automatically added to a new track.

     

   • Customize a digital human (public preview)

     During the public preview, Intelligent Cloud Editor provides four official digital humans for a free trial. In the asset area, you can add a text-driven or voice-driven digital human. Configure the parameters as required, and then click Initiate Digital Human And Generate Video. After the video is generated, the digital human is added to the video track.

     Because the official digital humans are not trained on real people, the results may not be optimal. If you have higher requirements, you can join the DingTalk group 84650000851 to experience the Professional Edition of the digital human feature.

     

5. After you finish editing, click Save in the upper-right corner to save the current editing project.

   You can also click Generate As Template or Export As in the upper-right corner to generate a template from this project or export it to the media library.

Live stream editing

1. Open the live stream editing project page.

   

   The live stream editing page consists of the following areas:

   Number	Description
   ①	Live signal source area
   ②	Video preview area
   ③	Editing operation area
   ④	Clip list area

2. Perform video splitting.

   In the upper-left corner of the editing operation area, click the or icon. Then, press and hold the left mouse button to adjust the clip length and click Generate Clip. The generated clip is saved automatically. You can view the generated video clips in the clip list area.

   

   You can also click the icon to revoke the operation or click Preview Clip to preview the clip.

3. Edit video clips.

   Select a video clip in the clip list area. In the upper-right corner, click Export To Video Editing to edit the video clip. For more information, see Editing features.

Advanced template editing

1. Open the advanced template editing project page.

   

   The advanced template editing page consists of the following areas:

   Number	Description
   ①	Video preview area
   ②	Editing group list area
   ③	Editing group asset area

2. In the editing group list area, click an editing group to replace its assets.

   • Replace video or image assets.

     In the editing group asset area, click a video or image, and then click Replace Asset. The media library for the current region opens. Select the replacement asset as required.

     

     If the media library does not contain the asset you need, you can upload it. For more information, see Upload media assets in the console.

   • Replace text assets.

     You can edit the text in the preview area or set the text properties in the editing group asset area.

     

3. Optional:Preview the video.

   In the editing group list area, click the icon to preview the video.

   Note

   If the editing group changes, the video is re-produced when you preview it. This process incurs online editing and storage fees. For more information about billing, see Intelligent Cloud Editor and Storage fees.

4. Produce the video.

   In the upper-right corner, click Produce Video. Configure the parameters for the exported video as required, and then click OK to export the produced video to the media library.

Video editing

Video editing is the process of combining multiple video clips, audio tracks, images, and other assets on a timeline to generate a new video file.

API operations

• Submit a video production job: Call the SubmitMediaProducingJob operation to combine one or more video, audio, image, and caption assets into a finished product. This operation supports complex Timeline configurations to meet various editing needs.

• Query a video production job: Call the GetMediaProducingJob operation and pass the JobId to query the job status and results.

Timeline configuration

The timeline configuration is the core of video editing and is key to defining the editing logic. A timeline describes how video, audio, image, and other assets are arranged and combined over time. A timeline consists of tracks, assets, and effects. For detailed configuration instructions, see Timeline configuration.

Basic timeline structure

{
  "VideoTracks": [
    {
      "VideoTrackClip": [
        {
          "MediaId": "Asset ID",
          "MediaURL":"The OSS URL of the video track clip"
        }
      ]
    }
  ],
  "AudioTracks": [
    {
      "AudioTrackClip": [
        {
          "MediaId": "Audio asset ID",
          "MediaURL":"The OSS URL of the audio track clip"
        }
      ]
    }
  ]
}

• VideoTracks: Video tracks, which are used to place video or image assets.

• AudioTracks: Audio tracks, which are used to place audio assets.

• Clips: The clips on each track, which include the asset ID, start time, and duration.

Timeline examples

The tutorials contain many examples that show how to use Timeline configurations to meet various complex video editing needs. The following table describes common scenarios and provides configuration examples.

Use an SDK for audio and video editing

Install the Intelligent Media Services (IMS) server-side software development kit (SDK) and complete the required configuration. For more information, see Preparations.

Live stream editing

• Submit a live stream editing job: Call the SubmitLiveEditingJob operation. After you submit a live stream editing job, the job is added to a queue and executed asynchronously.

• Query a live stream editing job: Call the GetLiveEditingJob operation to query the job status based on the jobId.

• Get media asset information: Call the GetMediaInfo operation to query the information of the generated media asset based on the MediaId.

Advanced template editing

1. Obtain the template information.

   Call the GetTemplate operation to obtain the template information. Specify the template ID in the TemplateId parameter.

   GetTemplateRequest request = new GetTemplateRequest();
   request.setTemplateId("****20b48fb04483915d4f2cd8ac****");
   GetTemplateResponse response = iceClient.getTemplate(request);
   GetTemplateResponseBody.GetTemplateResponseBodyTemplate template = response.getBody().getTemplate();
   System.out.println("templateId : " + template.getTemplateId());
   System.out.println("clipsParam : " + template.getClipsParam());

   The following output is returned:

   {
       "RequestId":"******11-DB8D-4A9A-875B-275798******",
       "Template":{
           "TemplateId":"****20b48fb04483915d4f2cd8ac****",
           "Name":"Advanced template test",
           "Type":"VETemplate",
           "Status":"Available",
           "ModifiedSource":"OpenAPI",
           "CreateSource":"OpenAPI",
           "Config":"{\"oss_url\":\"http://your-bucket.oss-cn-shanghai.aliyuncs.com/object.zip\"}",
           "ClipsParam":"{\"Text7\":\"text\",\"Text6\":\"text\",\"Text5\":\"text\",\"Text4\":\"text\",\"Text3\":\"text\",\"Text2\":\"text\",\"Text1\":\"text\",\"Text0\":\"text\",\"Media3\":\"mediaId\",\"Media2\":\"mediaId\",\"Media1\":\"mediaId\",\"Media0\":\"mediaId\"}",
           "PreviewMedia":"",
           "CoverURL":""
       }
   }

   Note

   You can also use built-in templates. The method of using built-in templates is similar to the method described in the preceding section. For more information about built-in templates, see Advanced templates.

2. Replace text and mediaId of the ClipsParam parameter with the actual values.

   {
       "Text0":"Subtitle 0",
       "Text1":"Subtitle 1",
       "Text2":"Subtitle 2",
       "Text3":"Subtitle 3",
       "Text4":"Subtitle 4",
       "Text5":"Subtitle 5",
       "Text6":"Subtitle 6",
       "Text7":"Subtitle 7",
       "Media0":"****20b48fb04483915d4f2cd8ac****",
       "Media1":"****20b48fb04483915d4f2cd8ac****",
       "Media2":"****20b48fb04483915d4f2cd8ac****",
       "Media3":"****20b48fb04483915d4f2cd8ac****"
   }

   Note

   • ClipsParam is a parameter for the production service. You can replace text with subtitles and mediaId with the ID or OSS URL of a media asset, including a video or an image. You can use subtitles and media assets together.

   • If only some fields are specified in the ClipsParam parameter, the subtitles that are not specified are left empty by default, and the default media assets of the template are used.

   • You can set a font for subtitles and an adaptation mode for videos and images. For more information, see Extended features.

3. Call the production service.

   Call the SubmitMediaProducingJob operation to submit an editing and production job. Specify the TemplateId and ClipsParam parameters.

   SubmitMediaProducingJobRequest request = new SubmitMediaProducingJobRequest();
   request.setTemplateId("****20b48fb04483915d4f2cd8ac****");
   request.setClipsParam("{\"Text7\":\" Subtitle 7\",\"Text6\":\" Subtitle 6\",\"Text5\":\" Subtitle 5\",\"Text4\":\" Subtitle 4\",\"Text3\":\" Subtitle 3\",\"Text2\":" Subtitle 2 "," Text1 ":" Subtitle 1 "," Text0 ":" Subtitle 0 "," Media3 ":"****20b48fb04483915d4f2cd8ac**** "," Media2 ":"****20b48fb04483915d4f2cd8ac**** "," Media1 ":"****20******** "," Media0 ":"****20b48fb04483915d4f2cd8ac**** "}");
   request.setOutputMediaConfig("{\"MediaURL\":\"http://your-bucket.oss-cn-shanghai.aliyuncs.com/object.mp4\"}");
   SubmitMediaProducingJobResponse response = iceClient.submitMediaProducingJob(request);
   System.out.println("jobid : " + response.getBody().getJobId());