The intelligent production service uses Alibaba Cloud media AI to process and generate media content. Supported features include intelligent thumbnails, landscape-to-portrait conversion, green screen keying, figure cutout, logo blurring, caption removal and extraction, chorus detection, and music rhythm detection.
Overview
Use cases
-
Media and entertainment: Process logos, captions, and cutouts to quickly produce and edit video content.
-
Multi-platform delivery: Convert video aspect ratios with the landscape-to-portrait service for cross-device distribution.
Features
-
All features are listed in Intelligent production.
-
Try the feature at the intelligent production online experience.
Limitations
-
Supported regions: Service regions.
-
MPS queue concurrency: Limitations.
Before you begin
Complete the following setup if you have not already done so.
-
Create an MPS queue dedicated to intelligent thumbnail jobs.
Upload the video to be processed to OSS.
If you want to create a job, directly upload the video to OSS. For more information, see Upload a video.
If you want to create a workflow and automatically trigger the workflow, you must add media buckets and create a workflow before you upload the video. After you specify the input and output media buckets and upload a media file to the input media bucket, MPS receives a message about the upload and triggers the associated workflow. After the workflow is complete, the processed media file is uploaded to the output media bucket. For more information, see Add media buckets.
Optional. Enable the notification feature. If you want MPS to send notifications on jobs and workflows to MNS topics or queues, configure an MNS queue or topic as required. For more information, see Set up notifications.
Submit jobs in the console
Only intelligent thumbnail jobs can be submitted or triggered by a workflow in the MPS console. All other intelligent production job types require API calls.
Single job
Log on to the MPS console.
In the top navigation bar, select a region from the drop-down list.
-
In the left-side navigation pane, choose Job Management.
-
Click the Intelligent Thumbnail tab, and then click Create Task.
-
Configure the parameters for the intelligent thumbnail job.
Parameter
Description
Input File Location
Click Select. In the Bucket drop-down list, select a bucket. Browse the folders under Path and select the input file.
Intelligent Thumbnail Pipeline
Select an MPS queue from the drop-down list.
NoteIf no MPS queues appear in the Intelligent Thumbnail Pipeline drop-down list, create one first. Create an MPS queue.
Output Path
Click Select. In the Bucket drop-down list, select a bucket. Browse the folders under Path and select the output path.
NoteIf the output and input paths match but filenames differ, the source file is preserved. If filenames are identical, OSS settings determine the overwrite behavior. To avoid conflicts and potential job failures, use a unique output filename. Prevent objects with the same name from being overwritten (Java SDK V1).
-
Click Submit to create the intelligent thumbnail job.
After submission, view the job status, configuration, and paths in the job list on the current tab.
Workflow
Log on to the MPS console.
In the top navigation bar, select a region from the drop-down list.
-
In the left-side navigation pane, choose .
-
Click Create Workflow.
-
Configure basic information for the workflow.
Parameter
Description
Workflow Name
Enter a name for the workflow.
Preset
Select Custom from the drop-down list.
-
Configure the Input node.
-
Click the pen icon to the right of the Input node to open the Input Settings page.
-
Configure the input parameters.
Parameter
Description
Input Bucket
This field is auto-populated after you select an input path.
Input Path
Click Select. In the Bucket drop-down list, select a bucket. Browse the folders under Path and select the input path.
Transcoding MPS queue
Select an MPS queue from the drop-down list.
Note-
This MPS queue handles transcoding and snapshotting. Set the intelligent thumbnail MPS queue in a subsequent node.
-
If no MPS queue is available, create one first. Create an MPS queue.
(Optional) Notifications
Click the toggle, select a message queue or message topic, and then select the specific queue or topic from the drop-down list.
NoteIf no notification queue or topic is available, enable notifications first. Configure workflow notifications.
-
-
Click OK to complete the Input node settings.
-
-
Add an Intelligent Thumbnail node.
-
Click the plus icon (+) to the right of the Input node and select Intelligent Thumbnail.
-
Click the pen icon to the right of the Intelligent Thumbnail node.
-
Configure the intelligent thumbnail settings.
Parameter
Description
Name
Enter a name for the thumbnail.
Intelligent Thumbnail Pipeline
Select an MPS queue from the drop-down list.
NoteIf no MPS queues appear in the Intelligent Thumbnail Pipeline drop-down list, create one first. Create an MPS queue.
Output Bucket
This field is auto-populated after you select an output path.
Output Path
Click Select to choose an OSS output location.
(Optional) Set Thumbnail
Click the toggle to set the generated image as the video thumbnail.
-
Click OK to complete the Intelligent Thumbnail node settings.
-
-
Configure the Publish node.
-
Click the pen icon to the right of the Publish node.
-
Set the publish type.
Parameter
Description
Publish Type
Set Publish Type to Auto.
-
Manual: Media status is set to Unpublished after the workflow completes. Publish manually from Manage media resources.
-
Auto: Media status is set to Published after the workflow completes.
Note-
Published: Access permissions for playback resources and snapshots inherit the bucket's permissions.
-
Unpublished: Access permissions for playback resources and snapshots are set to private.
-
-
-
Click OK to complete the Publish node settings.
-
-
Click Save to create the workflow.
The workflow triggers automatically when a matching file is uploaded to the specified path.
After a workflow instance completes, click Details in the Actions column to view the Intelligent Thumbnail node details. Copy the Task Name, then go to Job Management > Intelligent Thumbnail. Select Search by ID and paste the task name to find the job.
Submit jobs by API
-
Submit an intelligent production job.
Call the
SubmitIProductionJoboperation for media files (videos, images, or audio) in OSS. Use the FunctionName parameter to specify the capability. Submit an intelligent production job. -
Receive callback notifications.
When an intelligent production job completes, MPS sends a notification to the specified queue or topic in Simple Message Queue (formerly MNS), if event notifications are configured for the MPS queue. Receive notifications.
-
Query the job result.
Call the
QueryIProductionJoboperation with a job ID to query the status and result. Query an intelligent production job.