The CloudLens for SLS application provides out-of-the-box dashboards that you can use to monitor and analyze the consumption of resources in Simple Log Service.
Prerequisites
Log collection is enabled for important logs, detailed logs, job operational logs, audit logs, billing logs, error logs, and metrics in a project. For more information, see Enable the log collection feature.
Entry point
- Log on to the Log Service console.
In the Log Application section, click the Cloud Service Lens tab. Then, click CloudLens for SLS.
In the left-side navigation pane, click Access Monitoring, Collection Monitoring, Operation Monitoring, Job Monitoring, Quota Monitoring, or Billable Resource Monitoring below Report Center.
In the upper-left corner of the page that appears, select the project whose reports you want to view.
Overview
The Overview dashboard displays information about Simple Log Service projects in charts. The charts include Number of requests, Request Success Rate, Requests with Status Code 4xx, Requests with Status Code 5xx, Write traffic (raw size), Write traffic (after compression), Write traffic compression ratio, and Read Traffic.
Access Traffic Monitoring
The Access Traffic Monitoring dashboard displays information about access to Simple Log Service in charts. The charts include Total Requests, Clients, Users, Top 10 SourceIPs with Most Read Traffic, Top 10 SourceIPs with Most Write Traffic, Requests, Write Traffic, Trend of Write Traffic to Shards, Trend of Read Traffic from Shards, Read/Write Traffic/Minute, and Request IP Distribution.
Access Exception Monitoring
The Access Exception Monitoring dashboard displays information about abnormal access to Simple Log Service in charts. The charts include Total Requests, Percentage of Failed Requests, Quota Exceeded, Error Status Distribution, Logstore with Excessive Write Traffic, Error Requests, and Trend of Request Latency.
Consumer Group Monitoring
The Consumer Group Monitoring dashboard displays information about consumer groups in charts. The charts include Consumer Group, Logstore, Shard, Fall Behind, Data, Consumer Group, Top 10 Latency, and Trend of Consumer Group Latency.
Logtail Overall Status
The Logtail Overall Status dashboard displays information about Logtail in charts. The charts include Active Logtail, Data Traffic, Status, CPU, Logtail Overall Status, Trend of CPU, Trend of Memory, and Data Sending Traffic.
Logtail File Collection Monitoring
The Logtail File Collection Monitoring dashboard displays information about the files from which you want to collect logs in charts. The charts include Logtail File Collection, Machine Collection, Collection File Distribution, Trend of Log Collection, Trend of Average Latency, Trend of Parse Failure, and Trend of Send.
Logtail Exception Monitoring
The Logtail Exception Monitoring dashboard displays information about Logtail exceptions in charts. The charts include Active Logtail, Restart Logtail List, Restart Clients, and All Alarm.
Operation Monitoring
The Operation Monitoring dashboard displays information about Simple Log Service operation records in charts. The charts include Logstore Related Operation Count, Logstore Related Fail Operation, and Clients.
Job Monitoring
The Job Monitoring dashboard displays information about data import jobs of the new version, data shipping jobs of the new version, and Scheduled SQL jobs in charts. The charts include Ingest Success, Ingest Failed, Deliver Success, Deliver Failed, Ingest PubNet, Deliver PubNet, Process Speed, Process Lags, and Process Error.
Quota Monitoring
The Quota Monitoring dashboard displays information about quota exceeded events in charts. The charts include Overview of Resource Quota (80%) Warning, QuotaExceed, LogStore Usage Distribution, MachineGroup Usage Distribution, Logtail Config Usage Distribution, Project Write Inflow Usage Distribution, Project Overview of Basic Quota Usage, Project Overview of Write/Read Quota Usage, and Project Quota Exceeded Statistics.
SQL Quality Monitoring
The SQL Quality Monitoring dashboard displays information about the multi-dimensional analysis of user-executed SQL statements in charts. The charts include SQL Health Score, SQL Pattern Analysis, and Advices. This helps you monitor and optimize SQL statements and improve the query and analysis efficiency.
The dashboard consists of the following sections:
Overview: This section displays the SQL Health Score, SQL Report, and SQL Overall Performance charts. You can quickly understand the overall status of SQL executions.
SQL Metric: This section displays the PV 1 Hour, Latency_avg, UserAgent, and Latency charts. You can view the service metrics that are involved when you execute SQL statements.
Running Metric: This section displays the ApproxConc, Latency, SQL Processed Bytes/min, and SQL Processed Rows/min charts. You can view the core metrics of the internal SQL runtime.
SQL Pattern Analysis: This section displays top SQL patterns with the most executions and top SQL patterns with the highest resource consumption. You can identify the characteristics of SQL executions. The system extracts templates from executed SQL statements and forms SQL patterns.
Advices: This section displays suggestions to help you improve SQL executions. The system analyzes SQL statements that have execution errors and provides suggestions based on the analysis results.
Overview
This section displays the SQL Health Score, SQL Report, and SQL Overall Performance charts. You can quickly understand the overall status of SQL executions.
SQL Health Score
The heath score is calculated by using the following formula: (1 - Query failure rate) × 100.
SQL Metric
This section displays the PV 1 Hour, Latency_avg, UserAgent, and Latency charts. You can view the service metrics that are involved when you execute SQL statements.
Running Metric
This section displays the ApproxConc, Latency, SQL Processed Bytes/min, and SQL Processed Rows/min charts. You can view the core metrics of the internal SQL runtime.
SQL Pattern Analysis
This section displays top SQL patterns with the most executions and top SQL patterns with the highest resource consumption. You can identify the characteristics of SQL executions. The system extracts templates from executed SQL statements and forms SQL patterns.
Advices
This section displays suggestions to help you improve SQL executions. The system analyzes SQL statements that have execution errors and provides suggestions based on the analysis results.
Billable Resource Monitoring
The Billable Resource Monitoring dashboard displays information about billable resources of Simple Log Service in charts. The charts include Storage Size(Hot Storage), Storage Size(Cold Storage), Index Size(Log), Read/Write Traffic, Billing Items, Top Project, and Top Logstore.
