:Troubleshoot Bandwidth or QPS Overrun for Buckets in OSS

Overview

Alibaba Cloud Object Storage Service (OSS) is a massive, secure, low-cost, and highly durable cloud storage service provided by Alibaba Cloud. On the Basic Data page of the bucket in the OSS console, you can view the resource usage of OSS. If the bandwidth or QPS of the bucket exceeds the default limit, the bucket may be throttled. This topic describes how to troubleshoot bucket bandwidth or QPS overrun.

Background information

Log on to the OSS console, click Buckets, then click the name of the target bucket, choose Usage Query > Basic Data to view the resource usage of OSS.

Note:

• Bandwidth: 10Gbit/s in mainland China and 5Gbit/s in other regions. If this limit is reached, requests are throttled.
• Default QPS limit: 10,000 queries/s. When this limit is reached, the requests beyond the limit are denied.
• For more information about OSS limits and performance metrics, see Object Storage Service (OSS) limits.

1. Check whether OSS buckets have a sudden increase in Internet service bandwidth. If there is a sudden increase in Internet bandwidth, we recommend that you access the Alibaba Cloud Content Delivery Network (Content Cache Delivery Acceleration) product to cache OSS resources to reduce OSS Internet traffic. For more information about how to use Alibaba Cloud Content Delivery Network to accelerate OSS resources, see Use Alibaba Cloud Content Delivery Network to accelerate OSS access.
2. If you have access to Alibaba Cloud Content Delivery Network products, check whether the OSS buckets have Alibaba Cloud Content Delivery Network service bandwidth spikes. If you find a large number of Alibaba Cloud Content Delivery Network back-to-origin OSS requests, we recommend that you increase the Alibaba Cloud Content Delivery Network cache time and perform the following operations to actively warm up on the Alibaba Cloud Content Delivery Network side.

   Description: For more information about how to modify the cache expiration time, see Configure the cache expiration time.

   1. Log on to the Alibaba Cloud Content Delivery Network console.
   2. In the left-side navigation pane, click Refresh.
   3. On the Refresh Cache tab, configure preheating rules.
3. On the Operation Records tab, check whether you have submitted a request to refresh Alibaba Cloud Content Delivery Network resources.
4. Check whether the OSS bucket has an intranet bandwidth increase. If there is an intranet bandwidth increase, check whether your OSS bucket has a reasonable access increment.
5. Check whether the QPS of a bucket spikes more than 10000 times /s. The request side should reasonably control the number of concurrent operations and maintain a reasonable number of retries in the case of weak networks.
6. If unexpected traffic increases, we recommend that you enable OSS to enable log storage or real-time log query for log analysis. You can analyze whether the source IP address, Referer, and UA are centralized and whether there are illegal requests. For more information about illegal requests, see Troubleshoot and protect OSS against malicious traffic.

Applicable scope

• Object Storage Service (OSS)