The DataHub console provides several metrics that you can view on the topic details page, such as read/write requests, real-time traffic, and historical traffic. This topic describes these metrics.
Metrics
-
QPS: Read/write requests per second.
-
RPS: Read/write records per second.
-
Throughput: Read/write throughput per second, in KB.
-
Throughput (Uncompressed): Uncompressed read/write throughput per second, in KB.
-
Fails: The data volume of failed requests per second, in KB.
-
Latency: Read/write request latency per request, in microseconds.
QPS metrics
The QPS metrics show the number of read and write requests per second, as shown in the following graph:
RPS metrics
The RPS metrics show the number of read and write records per second, as shown in the following graph:
Throughput
The throughput metrics show the read and write data throughput, as shown in the following graph:
Throughput (Uncompressed) metrics
This metric was added in DataHub 2.25.
The Throughput (Uncompressed) metric shows the read/write data throughput when compression is disabled, as shown in the following graph:
If the compressed read/write throughput is higher than the uncompressed read/write throughput, this usually occurs for one of two reasons:
-
Compression is not enabled for read/write requests for the topic.
-
Compression is enabled, but read/write requests are not sent in batches and the write protocol is JSON.
Fails metrics
This metric was added in DataHub 2.25.
If a single request writes to multiple shards, the entire request is considered failed if any write operation fails.
The Fails metric shows the number of failed requests, as shown in the following graph:
Latency metrics
The Latency metric shows the read/write request latency, as shown in the following graph:
Real-time and historical traffic metrics
In the upper-right corner of the topic details page, you can click the dots below the chart to switch views.
The charts for historical traffic and real-time traffic (uncompressed) were added in DataHub 2.25.
Real-time traffic
When data is uncompressed, the chart appears as follows:
When data is compressed, the chart appears as follows:
Historical traffic
The historical traffic metric shows the request traffic for the topic over the last seven days.
