Description
OpenSearch provides four categories of statistical metrics for top searches: core metrics, traffic metrics, click metrics, and guided search metrics.
Core metrics
Metric | Definition | Calculation method | Dependency | Description |
Hot search PV | The number of successful top search requests. Failed requests due to reasons such as throttling are not counted for this metric. | Counts each top search request for which a success response is received. | Calculates the number of successful top search requests on the current day. | |
Hot search UV | The number of users who sent top search requests and received results. Failed requests due to reasons such as throttling are not counted. | Counts each user only once regardless of how many top search requests the user sent. | Depends on the user_id field that is specified in top search requests when users send requests by calling an API operation or using an OpenSearch SDK. | Calculates the number of users who sent top search requests on the current day. |
Hot search request error times | The number of times when a top search request is sent but an error message is received due to reasons such as throttling. | Counts each request for which an error message is received. | Indicates whether you need to adjust top searches, such as adding more top searches to the existing ones. | |
Hot search PV-CTR | The click-through rate (CTR) of top searches. | Divides Hot search IPV by Hot search PV. | Depends on the raw_query and from_request_id fields that are specified in search requests when users send requests by calling an API operation or using an OpenSearch SDK. | Calculates the CTR of top searches. |
Hot search UV-CTR | The CTR of users who sent top search requests and received results. | Divides Hot search IPV_UV by Hot search UV. | Depends on the raw_query and from_request_id fields that are specified in search requests when users send requests by calling an API operation or using an OpenSearch SDK, and the user_id field that is specified in top search requests. | Calculates the CTR of users who sent top search requests and received results. |
Hot search TOP3 PV-CTR | The CTR of the top three searches. | Divides the number of clicks on the top three searches by Hot search PV. | Depends on the from_request_id field that is specified in search requests when users send requests by calling an API operation or using an OpenSearch SDK. | Calculates the CTR of the top three searches. |
Guided search PV ratio | The ratio of searches that users perform by clicking top searches to all searches. | Divides Guided search PV by Search PV. | Depends on the from_request_id field that is specified in search requests when users send requests by calling an API operation or using an OpenSearch SDK. | Calculates the ratio of top search-guided searches to all searches. |
Guided search PV-CTR | The CTR of top search-guided searches. | Divides the item page view (IPV) of top search-guided searches by Guided search PV. | Depends on the raw_query and from_request_id fields that are specified in search requests when users send requests by calling an API operation or using an OpenSearch SDK. This metric also depends on the data collection feature and the uploaded behavioral data about user clicks. | Assesses the retrieval and sorting effects of top search-guided searches. |
Traffic metrics
Metric | Definition | Calculation method | Dependency | Description |
Hot search PV | The number of successful top search requests. Failed requests due to reasons such as throttling are not counted for this metric. | Counts each top search request for which a success response is received. | Calculates the number of successful top search requests on the current day. | |
Hot search UV | The number of users who sent top search requests and received results. Failed requests due to reasons such as throttling are not counted. | Counts each user only once regardless of how many top search requests the user sent. | Depends on the user_id field that is specified in top search requests when users send requests by calling an API operation or using an OpenSearch SDK. | Calculates the number of users who sent top search requests on the current day. |
Hot search request error times | The number of times when a top search request is sent but an error message is received due to reasons such as throttling. | Counts each request for which an error message is received. | Indicates whether you need to adjust top searches, such as adding more top searches to the existing ones. | |
Hot search request error rate | The ratio of failed top search requests to all top search requests. The requests failed due to reasons such as throttling. | Divides Hot search request error times by the sum of Hot search PV and Hot search request error times. | Indicates whether you need to adjust top searches, such as adding more top searches to the existing ones. |
Click metrics
Metric | Definition | Calculation method | Dependency | Description |
Hot search IPV | The number of clicks on top searches. | Counts each click on a top search. | Depends on the from_request_id field that is specified in search requests when users send requests by calling an API operation or using an OpenSearch SDK. | Calculates the number of clicks on top searches. |
Hot search IPV_UV | The number of users who clicked top searches. | Counts each user only once regardless of how many times the user has clicked top searches. | Depends on the raw_query and from_request_id fields that are specified in search requests when users send requests by calling an API operation or using an OpenSearch SDK, and the user_id field that is specified in top search requests. | Calculates the number of users who clicked top searches. |
Hot search PV-CTR | The CTR of top searches. | Divides Hot search IPV by Hot search PV. | Depends on the raw_query and from_request_id fields that are specified in search requests when users send requests by calling an API operation or using an OpenSearch SDK. | Calculates the CTR of top searches. |
Hot search UV-CTR | The CTR of users who sent top search requests and received results. | Divides Hot search IPV_UV by Hot search UV. | Depends on the raw_query and from_request_id fields that are specified in search requests when users send requests by calling an API operation or using an OpenSearch SDK, and the user_id field that is specified in top search requests. | Calculates the CTR of users who sent top search requests and received results. |
Hot search has clicked PV ratio | The ratio of top search requests whose results are clicked by users to all top search requests. | Divides the number of top search requests whose results are clicked by users by Hot search PV. | Depends on the from_request_id field that is specified in search requests when users send requests by calling an API operation or using an OpenSearch SDK. | Calculates the ratio of top search requests whose results are clicked by users to all top search requests. |
Hot search TOP1 PV-CTR | The CTR of the top one search. | Divides the number of clicks on the top one search by Hot search PV. | Depends on the from_request_id field that is specified in search requests when users send requests by calling an API operation or using an OpenSearch SDK. | Calculates the CTR of the top one search. |
Hot search TOP3 PV-CTR | The CTR of the top three searches. | Divides the number of clicks on the top three searches by Hot search PV. | Depends on the from_request_id field that is specified in search requests when users send requests by calling an API operation or using an OpenSearch SDK. | Calculates the CTR of the top three searches. |
Hot Search TOP5 PV-CTR | The CTR of the top five searches. | Divides the number of clicks on the top five searches by Hot search PV. | Depends on the from_request_id field that is specified in search requests when users send requests by calling an API operation or using an OpenSearch SDK. | Calculates the CTR of the top five searches. |
Guided search metrics
Metric | Definition | Calculation method | Dependency | Description |
Guided search PV | The number of top search-guided searches. Search requests include paging requests. | Counts each time when a user clicks a top search. | Depends on the from_request_id field that is specified in search requests when users send requests by calling an API operation or using an OpenSearch SDK. | Calculates the number of top search-guided searches. |
Guided search PV ratio | The ratio of top search-guided searches to all searches. | Divides Guided search PV by Search PV. | Depends on the from_request_id field that is specified in search requests when users send requests by calling an API operation or using an OpenSearch SDK. | Calculates the ratio of top search-guided searches to all searches. |
Guided search UV | The number of users who clicked top searches. | Counts each user only once regardless of how many times the user clicked top searches. | Depends on the user_id and from_request_id fields that are specified in search requests when users send requests by calling an API operation or using an OpenSearch SDK. | Calculates the number of users who clicked top searches. |
Guided search UV ratio | The ratio of users who clicked top searches to all users who sent top search requests and received results. | Divides Guided search UV by Search UV. | Depends on the user_id and from_request_id fields that are specified in search requests when users send requests by calling an API operation or using an OpenSearch SDK. | Calculates the ratio of users who clicked top searches to all users who sent top search requests and received results. |
Guided search no result rate | The ratio of top search-guided searches with empty results to all top search-guided searches. | Divides the number of top search-guided searches with empty results by Guided search PV. | Depends on the from_request_id field that is specified in search requests when users send requests by calling an API operation or using an OpenSearch SDK. | Calculates the ratio of top search-guided searches with empty results to all top search-guided searches. |
Guided search PV-CTR | The CTR of top search-guided searches. | Divides the IPV of top search-guided searches by Guided search PV. | Depends on the raw_query and from_request_id fields that are specified in search requests when users send requests by calling an API operation or using an OpenSearch SDK. This metric also depends on the data collection feature and the uploaded behavioral data about user clicks. | Assesses the retrieval and sorting effects of top search-guided searches. |
Guided search has clicks on the percentage of PV | The ratio of top search-guided searches whose results are clicked by users to all top search-guided searches. | Divides the number of top search-guided searches whose results are clicked by users by Guided search PV. | Depends on the from_request_id field that is specified in search requests when users send requests by calling an API operation or using an OpenSearch SDK. This metric also depends on the data collection feature and the synchronization of events about user clicking search results. | Calculates the ratio of top search-guided searches whose results are clicked by users to all top search-guided searches to assess the effects of search retrieval and sorting. |
Guided search for GMV | The gross merchandise volume (GMV) of purchases that users make based on top search-guided searches. | Aggregates the transaction amounts guided by top searches. | Depends on the data collection feature and the uploaded behavioral data about user purchases. The value of the bhv_type field must be buy in the data that is uploaded. | Assesses the effect of top searches on guiding users to make purchases. |
Guided search favorite conversion rate | The ratio of times when users add items to favorites from the results of top search-guided searches to all top search-guided searches. | Divides the number of times when users add items to favorites from the results of top search-guided searches by Guided search PV. | Depends on the data collection feature and the uploaded behavioral data about adding items to favorites. The value of the bhv_type field must be collect in the data that is uploaded. | Assesses the effect of top searches on guiding users to add items to favorites. |
Guided search to the shopping cart conversion rate | The ratio of times when users add items to the shopping cart from the results of top search-guided searches to all top search-guided searches. | Divides the number of times when users add items to the shopping cart from the results of top search-guided searches by Guided search PV. | Depends on the data collection feature and the uploaded behavioral data about adding items to the shopping cart, bookshelf, or playlist. The value of the bhv_type field must be cart in the data that is uploaded. | Assesses the effect of top searches on guiding users to add items to the shopping cart. |
Guided search like conversion rate | The ratio of times when users like items in the results of top search-guided searches to all top search-guided searches. | Divides the number of times when users like items in the results of top search-guided searches by Guided search PV. | Depends on the data collection feature and the uploaded behavioral data about liking items. The value of the bhv_type field must be like in the data that is uploaded. | Assesses the effect of top searches on guiding users to like items. |
Guided search review conversion rate | The ratio of times when users post comments on items in the results of top search-guided searches to all top search-guided searches. | Divides the number of times when users post comments on items in the results of top search-guided searches by Guided search PV. | Depends on the data collection feature and the uploaded behavioral data about posting comments. The value of the bhv_type field must be comment in the data that is uploaded. | Assesses the effect of top searches on guiding users to post comments on items. |
Usage notes
When the top search report displays metrics for a day, the report displays the metrics for the day before the current day by default. You can set the date picker control to another day as needed. After you upload behavioral data, the top search report based on the uploaded data is available on the next day.
The top search report provides line charts to display the trends of metrics in the last seven days. You can set the date picker control to another time period as needed. You can view the line chart of a metric by clicking the corresponding icon.
To view a line chart, perform the following steps: In the left-side navigation pane, choose Report Statistics > Top search report. Select an application from the Application Name drop-down list and a model from the Model name drop-down list. Click a metric category tab. Then, set the date picker control to a time period as needed.
