The LVM-Text-Ratio Filter (DLC) component filters out videos that contain excessive text. Only MP4 videos are supported. This component is suitable for video editing and content review scenarios where you want to automatically identify and exclude text-heavy video segments.
Supported computing resources
Algorithm
The LVM-Text-Ratio Filter (DLC) component samples video frames and calculates the text area ratio to estimate the overall text proportion of a video. Videos with an excessive text ratio are filtered out to ensure data quality, typically for training video generation models.
Inputs and outputs
Input ports
-
The Read File Data component reads the Object Storage Service (OSS) path where the training data is stored.
-
Configure the OSS Data Path parameter to select the OSS directory where the video data is stored, or select the video metadata file. For more information, see the parameter description in the following section.
-
Any LVM Data Processing (DLC) component can be used as the input.
Output port
The filtering results. For more information, see the parameter description in the following section.
Configure the component
Configure the LVM-Text-Ratio Filter (DLC) component in Machine Learning Designer. The following table describes the parameters.
|
Tab |
Parameter |
Required |
Description |
Default value |
|
|
Field Settings |
Video Data OSS Path |
No |
If no upstream component exists the first time you run this component, manually select the OSS directory where the video data is stored. When the component runs, the video metadata file video_meta.jsonl is generated in the parent directory of the specified directory. For subsequent runs, you can directly select the video_meta.jsonl file. |
No default value |
|
|
Output File OSS Path |
Yes |
The OSS directory where the filtering results are stored. The results include the following files:
|
No default value |
||
|
Output Filename |
Yes |
The file name of the filtering results. |
result.jsonl |
||
|
Parameter Settings |
Minimum Text Area Ratio |
Yes |
The minimum text area ratio. |
0 |
|
|
Maximum Text Area Ratio |
Yes |
The maximum text area ratio. |
1 |
||
|
Number of Sampled Frames |
Yes |
The number of video frames to sample. Frames are evenly collected across the video duration for analysis. |
1 |
||
|
Execution Tuning |
Number of Processes |
Yes |
The number of processes. |
4 |
|
|
Select Resource Group |
Public Resource Group |
No |
The instance type (CPU or GPU) and virtual private cloud (VPC) to use. You must select the GPU instance type for this algorithm. |
No default value |
|
|
Dedicated resource group |
No |
The number of vCPUs, memory, shared memory, and GPUs to use. |
No default value |
||
|
Maximum Running Duration (seconds) |
No |
The maximum duration that the component can run. The job is terminated if this duration is exceeded. |
No default value |
||