Intelligent Cloud Editor provides online video editing capabilities that allow you to produce new videos from audio, video, and text assets. This topic describes how to create, manage, and edit online editing projects. You can enhance your projects by using intelligent features to add stickers, filters, effects, and subtitles.
Features
Video editing — Trim, stitch, and add effects to assets such as video clips, audio files, and images.
Live stream editing — Edit and output video content in real time during a live stream.
Advanced template editing — Generate videos from preset templates.
Prerequisites
Upload the required media assets to the media library. For instructions, see Upload media assets in the console.
To use the intelligent text-to-speech feature, configure a default storage address for the generated audio. For more information, see Configure a storage address.
Online editing in the console
Access the online editing console
Log on to the Intelligent Media Services (IMS) console.
In the left-side navigation pane, choose Intelligent Production > Online Editing to go to the Online Editing page.
Create an editing project
Video editing project
Video editing project
Intelligent Cloud Editor allows you to edit live streams and recorded files.
Click the Video Editing Projects tab.
Click Create Editing Project, enter a project name, and then click OK.
In the Operation column of the project, click Clip to open the standard editing project interface.
Live stream editing project
Live stream editing project
Click the Live Editing Project tab.
Click Create Live Editing Project, configure the required parameters described in the following table, and then click OK.
Parameter | Description |
Live stream editing name | A custom name for the live stream editing project. The name can contain letters, digits, spaces, and underscores (_) and cannot exceed 60 characters. |
Live stream URL | Enter the URL of the Alibaba Cloud live stream that you want to edit. For information about how to obtain a live stream URL, see Generate live stream URLs. Only HLS (m3u8) streams over HTTPS are supported. To edit a live stream, you must first enable live stream recording. For more information, see Record and store to OSS and Record and store to VOD. |
Storage method | Configure the storage destination for the generated live stream clips. Supported destinations are Object Storage Service (OSS) and ApsaraVideo VOD. |
Storage address |
|
You can add OSS buckets. If no buckets are available, you can create a bucket in the OSS console. For more information, see Create buckets. | | Start time | Select a start time for live stream editing. You can choose to Start or Start from Reserved Time. Before the live stream starts, you can modify the schedule in the online editing list. After the live stream starts, recording begins automatically, and you can edit the stream in real time. |
In the Operation column of the project, click View to open the live stream editing interface. For more information about live stream editing, see .
Advanced template editing project
Advanced template editing project
Click the Advanced Editing Project tab.
Click Create Editing Project, and then click OK to go to the Advanced Templates page.
In the Operation column of the template, click Use Template. Enter a project name, and then click OK to open the advanced template editing interface. For details about advanced template editing, see .
Manage editing projects
In the Operation column, you can click Editing, Copy, or Export Template. To delete a project, click 
and then Delete.
This section uses a standard editing project as an example. The procedures for other types of editing projects are similar.
The standard editing project list displays information such as the project name, video type, creation time, and last update time. In the Actions column, you can edit the project or view its details.
Editing features
Video editing
Open the video editing project interface.
The video editing project interface is divided into four main areas. The Asset area in the upper-left is for managing imported media assets, and the central Preview area is for real-time video playback. The Property area on the right is for adjusting asset parameters, and the Editing area at the bottom provides a multi-track timeline for editing operations.
The following table describes the areas of the standard editing interface.
Number
Description
①
Asset area
②
Preview area
③
Property area
④
Editing area
Import assets.
In the upper-right corner of the asset area, click Import to open the media library for the current region. Select the required assets.
In the media library, you can filter assets by the All, Video, Audio, or Image category. You can also search for assets by name in the search box at the top.
If the asset you need is not in the media library, you can upload it. For more information, see Upload media assets in the console.
Add assets to the editing area.
Click the
icon on an asset or drag the asset to a track in the editing area.You can also add public resources such as Stickers, Filters, and Effects to create multi-track projects and preview the results in real time.
Edit assets.
Trim, preview, or adjust asset properties
Select an asset on a track in the editing area. Use the tools in the upper-left corner of the editing area for operations such as trimming or deleting. In the preview area, you can preview, drag, scale, and reposition the asset. In the property area, you can adjust its properties.
Add a transition effect
In the editing area, select the video or image to which you want to add a transition. In the asset area, click Transitions and select a transition effect, such as a vortex. You can view the effect in the preview area.
Smart subtitle generation
Select a video in the editing area. On the Basic tab in the property area, click Intelligent Subtitling. The generated subtitles are automatically loaded onto a new track.
Display the audio waveform for a video
Select a video in the editing area. Click the
icon to select the type of waveform to display. The corresponding waveform appears below the video on the track.Smart dubbing
In the editing area, select the subtitle for which you want to generate a voiceover. Click the
icon to set the voice type, and then click Smart dubbing. The generated voiceover is automatically loaded onto a new track.
NoteIf the message "Please configure the storage path first" appears, you must configure a storage path. For more information, see Configure a storage address.
Add markers or mark clips
In the editing area, select a video and drag the timeline to a specific position. Click the
icon to add a marker. Click the 
or 
icon to add in and out points for a clip. You can also click the 
and 
icons, or the markers and clips above the video on the track, to view their details.Separate an audio track from a video
Select a video in the editing area. On the Basic tab in the property area, click Separate audio track. The separated audio track is automatically loaded onto a new track.
Customize a digital human (Public preview)
During the public preview, Intelligent Cloud Editor provides four official digital humans for a free trial. You can add a text-driven or voice-driven digital human from the asset area, configure its parameters as needed, and then click Initiate Digital Human and Generate Video. The digital human is added to the video track after synthesis is complete.
The quality of the official digital humans may not be optimal because they are not trained on real human data. If you require higher quality, you can join the DingTalk group (ID: 84650000851) to try the professional version of the digital human feature.
The left-side panel in the asset area displays a list of available digital humans. Select one to view its appearance in the preview area.
After you finish editing, click Save in the upper-right corner to save the project.
You can also click Generate as Template or Export Video in the upper-right corner to generate a template from the project or export the video to the media library.
Live stream editing
Live stream editing
Open the live stream editing project interface.
The live stream editing interface is divided into four areas. The Live signal source area on the left displays the live stream. The central Video preview area previews the edited content. The Editing area at the bottom provides a timeline for creating clips. The Clip list area on the right manages the generated video clips.
The following table describes the areas of the live stream editing interface.
Number
Description
①
Live signal source area
②
Video preview area
③
Editing area
④
Clip list area
Split the video into clips.
In the upper-left corner of the editing area, click the
or 
icon. Press and hold the left mouse button to adjust the clip duration, and then click Generate Clip. The generated clip is automatically saved and appears in the clip list area.You can also click the
icon to undo the last action or click Preview Clip to preview a clip.Edit video clips.
In the clip list area, select a video clip and click Export To Video Editing in the upper-right corner to continue editing the clip. For more information, see .
Advanced template editing
Advanced template editing
Open the advanced template editing project interface.
The advanced template editing interface is divided into three areas. The central Video preview area provides a real-time preview of the template effect. The Editing group list area at the bottom displays the editing groups in the template. The Editing group asset area on the right lets you replace and edit the assets in the current group.
The following table describes the areas of the advanced template editing interface.
Number
Description
①
Video preview area
②
Editing group list area
③
Editing group asset area
In the editing group list area, click an editing group to replace its assets.
Replace video or image assets.
In the editing group asset area, click a video or image, and then click Replace Asset. The media library for the current region opens. Select a replacement asset.
If the asset you need is not in the media library, upload it. For instructions, see Upload media assets in the console.
Replace text assets.
Edit the text in the preview area or set the text properties in the editing group asset area.
When you select a text asset, a yellow editing border appears in the preview area. You can drag the border to adjust the asset's position and size. In the property panel on the right, you can configure the text content, font size, color, and position.
(Optional) Preview the video.
In the editing group list area, click the
icon to preview the video.NoteIf you modify an editing group, the service regenerates the preview video, which incurs online editing and storage fees. For billing details, see Intelligent Cloud Editor and Storage fees.
Produce the video.
In the upper-right corner, click Export Video. Configure the export parameters as required, and then click OK to export the composed video to the media library.
Online editing with OpenAPI
Video editing
Video editing
Video editing combines multiple assets, such as video clips, audio, and images, on a timeline to generate a new video file.
API reference
Submit a media producing job: Call the SubmitMediaProducingJob API to combine one or more video, audio, image, and subtitle assets into a final product. This API supports complex timeline configurations to meet diverse editing requirements.
Query a media producing job: Call the GetMediaProducingJob API and pass the
JobIdto retrieve the job status and results.
Troubleshoot a job that returns no response and does not appear in the console
If a job produces no response after submission and does not appear in the console task list, check the following items:
Confirm that the frontend call passes all required parameters, such as the OSS address of the media asset, the template ID, and the output configuration.
Confirm that your account has subscribed to Intelligent Media Services (IMS), and that the OSS input path has read permissions and is in the same region as your project.
Check whether the backend correctly calls the
SubmitMediaProducingJobAPI and receives a response.If the job does not appear in the console task list, it may not have been successfully submitted to the backend. Focus your troubleshooting on the frontend submission action and the backend's handling of the request.
Timeline configuration
The timeline configuration is the core of video editing and defines the editing logic. A timeline defines how assets such as video, audio, and images are arranged and combined over time. It primarily consists of tracks, assets, and effects. For detailed configuration instructions, see timeline configuration details.
The following example shows a basic timeline structure:
{
"VideoTracks": [
{
"VideoTrackClip": [
{
"MediaId": "The asset ID.",
"MediaURL":"The OSS URL of the clip."
}
]
}
],
"AudioTracks": [
{
"AudioTrackClip": [
{
"MediaId": "The audio asset ID.",
"MediaURL":"The OSS URL of the clip."
}
]
}
]
}VideoTracks: Video tracks used to place video or image assets.AudioTracks: Audio tracks used to place audio assets.Clips: The segments within each track, containing the asset ID, start time, and duration.
Timeline examples The following table lists common use cases and links to configuration examples that show how to implement complex video edits by using timeline configurations.
Example | Description |
Supports features such as converting landscape video to portrait, video trimming, mixing videos and images, and adding watermarks, stickers, and animated GIF stickers. | |
Supports features such as muting, volume adjustment, audio mixing, audio extraction, and audio normalization. | |
Supports adding subtitles to videos, creating stylized text, automatically breaking subtitle lines, aligning subtitles, and applying subtitle effects. | |
Supports various transitions (such as fade-in and fade-out), visual effects (such as blur and sharpen), and filters (such as black-and-white and vintage). | |
Supports features such as speech-to-text (STT) for merging subtitles into a video, text-to-speech (TTS) for merging audio into a video, and SSML for controlling rhythm or pronunciation. | |
Supports adding global background images, global watermark logos, and more. |
The OSS URLs of media assets do not support cross-region references. Make sure that the OSS bucket and the IMS job are in the same region, such as the China (Shenzhen) region. Otherwise, rendering may produce abnormal results or composition may fail.
Audio and video editing with the SDK Install and configure the IMS server-side SDK. For more information, see Prerequisites.
Live stream editing
Live stream editing
Submit a live stream editing job: Call the SubmitLiveEditingJob API. After submission, the job is queued for asynchronous execution.
Query a live stream editing job: Call the GetLiveEditingJob API to query the job status by
jobId.Get media asset information: Call the GetMediaInfo API to query information about a generated media asset by
MediaId.
Advanced template editing
Retrieve template information.
Call the GetTemplate operation and set the
TemplateIdparameter to retrieve the template information.GetTemplateRequest request = new GetTemplateRequest(); request.setTemplateId("****20b48fb04483915d4f2cd8ac****"); GetTemplateResponse response = iceClient.getTemplate(request); GetTemplateResponseBody.GetTemplateResponseBodyTemplate template = response.getBody().getTemplate(); System.out.println("templateId : " + template.getTemplateId()); System.out.println("clipsParam : " + template.getClipsParam());The following example shows a sample response:
{ "RequestId":"******11-DB8D-4A9A-875B-275798******", "Template":{ "TemplateId":"****20b48fb04483915d4f2cd8ac****", "Name":"AdvancedTemplateTest", "Type":"VETemplate", "Status":"Available", "ModifiedSource":"OpenAPI", "CreateSource":"OpenAPI", "Config":"{\"oss_url\":\"http://your-bucket.oss-cn-shanghai.aliyuncs.com/object.zip\"}", "ClipsParam":"{\"Text7\":\"text\",\"Text6\":\"text\",\"Text5\":\"text\",\"Text4\":\"text\",\"Text3\":\"text\",\"Text2\":\"text\",\"Text1\":\"text\",\"Text0\":\"text\",\"Media3\":\"mediaId\",\"Media2\":\"mediaId\",\"Media1\":\"mediaId\",\"Media0\":\"mediaId\"}", "PreviewMedia":"", "CoverURL":"" } }NoteYou can also use system-provided templates. The procedure is similar to using a custom template. For more information about system-provided templates, see Public template library - Advanced templates.
As required, replace the
textandmediaIdfields in theClipsParamparameter that was returned in the previous step.{ "Text0":"Caption0", "Text1":"Caption1", "Text2":"Caption2", "Text3":"Caption3", "Text4":"Caption4", "Text5":"Caption5", "Text6":"Caption6", "Text7":"Caption7", "Media0":"****20b48fb04483915d4f2cd8ac****", "Media1":"****20b48fb04483915d4f2cd8ac****", "Media2":"****20b48fb04483915d4f2cd8ac****", "Media3":"****20b48fb04483915d4f2cd8ac****" }NoteClipsParamis a parameter for the production service. You can replace `text` with your text content and `mediaId` with a media asset ID or its OSS URL. Videos and images are supported. You can use a combination of IDs and URLs.If you set only some fields in the
ClipsParamparameter, unspecified captions are empty by default, and unspecified media assets default to the original assets in the template.You can set fonts for captions and adaptation modes for videos and images. For more information, see Extended features.
You can call the synthesis service.
Call the SubmitMediaProducingJob operation to submit a video editing and production job. Set the
TemplateIdandClipsParamparameters.SubmitMediaProducingJobRequest request = new SubmitMediaProducingJobRequest(); request.setTemplateId("****20b48fb04483915d4f2cd8ac****"); request.setClipsParam("{\"Text7\":\"Caption7\",\"Text6\":\"Caption6\",\"Text5\":\"Caption5\",\"Text4\":\"Caption4\",\"Text3\":\"Caption3\",\"Text2\":\"Caption2\",\"Text1\":\"Caption1\",\"Text0\":\"Caption0\",\"Media3\":\"****20b48fb04483915d4f2cd8ac****\",\"Media2\":\"****20b48fb04483915d4f2cd8ac****\",\"Media1\":\"****20b48fb04483915d4f2cd8ac****\",\"Media0\":\"****20b48fb04483915d4f2cd8ac****\"}"); request.setOutputMediaConfig("{\"MediaURL\":\"http://your-bucket.oss-cn-shanghai.aliyuncs.com/object.mp4\"}"); SubmitMediaProducingJobResponse response = iceClient.submitMediaProducingJob(request); System.out.println("jobid : " + response.getBody().getJobId());
FAQ
What should I do if a video still has no sound after adjusting the audio parameters?
If a video still has no sound after you adjust the audio parameters, check the following items:
The Loudness value of the background music is too low: If the Loudness value of the background music track is set too low (for example, -26), the ALoudNorm volume normalization effect may suppress the audio. We recommend that you adjust the value to between -18 and -14.
Track layer overlap: Check whether the video tracks have overlapping layer levels. Adjust the track layer levels to resolve the overlap.
What should I do if hardcoded subtitles are also flipped after mirroring a video?
Hardcoded subtitles are part of the video's pixel data, so they are mirrored together with the entire video. You cannot use Timeline parameters alone to mirror the video while keeping the subtitles unmirrored. To resolve this issue, first remove the hardcoded subtitles from the original video. Then, mirror the video and add the subtitles as a separate subtitle track. This way, the subtitles are not flipped along with the video.
What should I do if the AI_TTS audio track is not displayed or has no sound during console preview?
Project preview in the Intelligent Media Services console does not currently display AI_TTS (text-to-speech) tracks or play their audio. AI_TTS takes effect only in the final produced video. To verify the AI_TTS audio, export the project and check the produced video. The missing track and the silence in the preview area are expected behavior, not a failure.
How do I view the rendering concurrency quota for online editing and the number of concurrent jobs in use?
Viewing concurrency usage: The console does not currently show the number of concurrent jobs in use in real time. You can call the ListMediaProducingJobs operation to query job status and evaluate queuing and processing.
Scheduling mechanism: Concurrency for online editing is scheduled centrally by the Alibaba Cloud backend and is not a fixed, account-level hard quota. The system dynamically determines the available concurrency based on the overall resource load and job complexity. Jobs that exceed the available concurrency are queued automatically.
Quota calculation: The concurrency quota is calculated independently for each account and region combination, and is separate from the quotas for other features such as transcoding.
Can a media producing job be canceled?
One-Click Video Generation jobs submitted by SubmitBatchMediaProducingJob cannot be canceled. For a standard media producing job submitted by SubmitMediaProducingJob, see the API reference of this operation to confirm whether cancellation is supported.