Call SearchMediaByHybrid to perform a hybrid search for media assets using natural language - Intelligent Media Services - Alibaba Cloud - Intelligent Media Services

Hybrid media asset search. Combines the text search capability of DataQ - Smart Tag Service and the LLM-based search capability to perform multi-channel recall, allowing users to search using natural language descriptions.

Operation description

For questions about or assistance with the Intelligent Media Services intelligent media asset search feature on Alibaba Cloud, please search for the DingTalk group (30415005038) and join the Intelligent Media Services multimodal search Customer support DingTalk group to contact us.

Try it now

Try this API in OpenAPI Explorer, no manual signing needed. Successful calls auto-generate SDK code matching your parameters. Download it with built-in credential security for local usage.

Test

RAM authorization

The table below describes the authorization required to call this API. You can define it in a Resource Access Management (RAM) policy. The table's columns are detailed below:

Action: The actions can be used in the Action element of RAM permission policy statements to grant permissions to perform the operation.
API: The API that you can call to perform the action.
Access level: The predefined level of access granted for each API. Valid values: create, list, get, update, and delete.
Resource type: The type of the resource that supports authorization to perform the action. It indicates if the action supports resource-level permission. The specified resource must be compatible with the action. Otherwise, the policy will be ineffective.
- For APIs with resource-level permissions, required resource types are marked with an asterisk (*). Specify the corresponding Alibaba Cloud Resource Name (ARN) in the Resource element of the policy.
- For APIs without resource-level permissions, it is shown as All Resources. Use an asterisk (*) in the Resource element of the policy.
Condition key: The condition keys defined by the service. The key allows for granular control, applying to either actions alone or actions associated with specific resources. In addition to service-specific condition keys, Alibaba Cloud provides a set of common condition keys applicable across all RAM-supported services.
Dependent action: The dependent actions required to run the action. To complete the action, the RAM user or the RAM role must have the permissions to perform all dependent actions.

Action

Access level

Resource type

Condition key

Dependent action

ice:SearchMediaByHybrid

get

*All Resource

*

None

Request parameters

Parameter	Type	Required	Description	Example
SearchLibName	string	No	The name of the search library	test-1
MediaType	string	No	The type of media assets. Valid values: image video Valid values: image : image video : video	video
PageNo	integer	No	The page number. Default value: 1.	1
PageSize	integer	No	The number of entries per page. Valid values: 1 to 50. Default value: 10.	20
Text	string	No	The natural language search query.	Two pandas fighting
MediaId	string	No	The ID of the media asset. If provided, the details of the media asset are returned.	**c469e944b5a856828dc2**
Namespace	string	No	The namespace.	name-1
CustomFilters	string	No	Custom filters. A JSON string. Supported backing fields include integer field intField1 and string fields strField1 and strField2. Only one matching condition can be applied per field, and filters across different fields are combined with a logical AND relationship. Exact match example: {"intField1":12,"strField1":"abc"} Multi-value example: {"intField1":[12,13],"strField1":["abc","cd"]} Range example: {"intField1":{"gte":12,"lte":13}}	{"intField1":{"gte":12,"lte":13},"strField2":["cd","de"],"strField1":"abc"}
UtcCreate	string	No	Creation time, in milliseconds UNIX timestamp. gte means greater than or equal to, and lte means less than or equal to. Range example: {"gte":1761205662998,"lte":1771205662998}	{"gte":1761205662998,"lte":1771205662998}

Response elements

Element	Type	Description	Example
	object	Schema of Response
RequestId	string	The request ID.	****3B-0E1A-586A-AC29-742247****
Success	string	Indicates whether the request was successful. Valid values: true and false.	true
Code	string	The status code returned.	200
MediaList	array<object>	The media assets that match the search query.
	array<object>	The media asset that matches the search query.
MediaId	string	The ID of the media asset.	a18936e0e28771edb59ae6f6f47a****
ClipInfo	array<object>	The information about the relevant clips.
	object	The information about the clip.
From	number	The start time of the relevant clip.	2
To	number	The end time of the relevant clip.	4
Score	number	The relevance score of the clip for the query.	0.99
Total	integer	The total number of media assets that match the search criteria.	30

Examples

Success response

JSON format

{
  "RequestId": "******3B-0E1A-586A-AC29-742247******",
  "Success": "true",
  "Code": "200",
  "MediaList": [
    {
      "MediaId": "a18936e0e28771edb59ae6f6f47a****",
      "ClipInfo": [
        {
          "From": 2,
          "To": 4,
          "Score": 0.99
        }
      ]
    }
  ],
  "Total": 30
}

Error codes

See Error Codes for a complete list.

Release notes

See Release Notes for a complete list.