Intelligent Media Services:Video translation

Method 1: Create in the console

1. Go to the Video Translation page in the IMS console.

2. In the upper-left corner, select a region as needed.

3. Click Create Translation Task.

4. Configure parameters:

   • Translation Method: Select Subtitle Translation, Speech Translation, or Lip-sync Translation.

   • Select Source File: Upload the video file to be translated. MP4, WebM, and MOV formats are supported.

   • Subtitle Source: Specify whether to erase the original subtitles and the subtitle source. The following methods are supported:

     • OCR: Extracts built-in subtitles from the video using OCR. Set the OCR Range to improve accuracy.

     • ASR: Converts speech to text when the video has no subtitles.

     • OCR/ASR: Tries OCR first, then falls back to ASR.

     • Specified SRT File: Loads an existing caption file to synchronize with the video.

     • All: Recognizes subtitles by ASR and refines them through OCR to correct typos.

   • Target Language: Select one or more target languages. The system generates corresponding output videos.

   • Storage Directory and File Name: Specify the storage location and name for the output file.

5. Click Submit Translation Task to create a task.

6. View the task status, configurations, and translation results in the task list. When the status is Processed, click View Details to view basic information, advanced settings, and outputs.

   

Method 2: Create using cloud editing

Preparations

If you are not familiar with cloud editing, start with its basic operations.

Procedure

1. Go to the Cloud Editing page in the IMS console.

2. In the upper-left corner, select a region as needed.

3. Click Create Editing Project, then click Edit in the Actions column to open the project.

4. On the Materials tab, click Import and select the materials to translate. After they are added to Materials, click the plus sign or drag the file to the editing area.

5. Select the audio or video to translate in the editing track, then click AI translation. Configure the translation type, subtitle extraction, language, and subtitle erasure settings, and click Submit.

6. Wait a few minutes. The translated result appears in the track.

7. Click Generate As > Generate in the upper-right corner. Configure the video production parameters and click OK to export the translated video.

Method 3: Create through OpenAPI

1. Create a translation task

   Call SubmitVideoTranslationJob to create a video translation task. Related parameters: Video translation parameters.

2. Query the result of a translation task

   To get the status and result of a video translation task, call GetSmartHandleJob. The API returns processing progress, completion time, and output URLs.

3. Query translation task list

   To view all ongoing or completed video translation tasks, call ListSmartJobs.

4. Delete a translation task

   Call DeleteSmartJob to delete a completed task and release resources.

Method 1: Use OpenAPI

Detailed API operations: Speech translation with post-editing.

Method 2: Use cloud editing (Web SDK)

Preparations

If you are not familiar with cloud editing, start with its basic operations.

Procedure

1. Go to the Video Translation page and select the task to modify.

2. Click Edit in the Actions column to open the project. Follow the video tutorial below to modify your translation results.

How do I align subtitle timing with the audio waveform?

Example:

To split the translated subtitle "Great where are you" into two segments ("Great" and "where are you"), align the start and end times with the troughs of the waveform. This optimizes the post-editing effect for speech translation.

Word count limit during post-editing

Keep the adjusted content within 1.5 times the original word count. Exceeding this limit may cause overly fast speech.

Example

Initial translation: Let's talk about this later. We need to go home now.

Inappropriate adjustment: Let's discuss this matter in more detail at a later time. Right now, we should focus on heading back home as it's important to ensure we get there safely and in good time. We can revisit this conversation when we are both more relaxed and have ample opportunity to explore all the aspects thoroughly.

Appropriate adjustment: Let's pick this up another time. We should be going home now.