DataHub supports the monitoring and alerting feature of CloudMonitor. You can create alert rules to configure monitoring and alerting for DataHub metrics. Only the readMetric, writeMetric, and subscription and consumption metrics are supported.
Monitoring metrics
The following table describes the metrics that are supported in DataHub:
Parameter | Description |
readMetric | Data Consumption Requests per Second (Unit: counts) |
Read Throughput after Compression (Unit: KB) | |
Read Throughput after Compression (Unit: KB) | |
Number of Data Consumption Failures (Unit: counts) | |
Read RPS (Unit: counts) | |
Data Consumption Request Latency (Unit: microseconds) | |
writeMetric | Write Requests per Second (Unit: counts) |
Write Throughput after Compression (Unit: KB) | |
Raw Throughput for Data Write (Unit: KB) | |
Number of Data Write Failures (Unit: counts) | |
Write RPS (Unit: counts) | |
Data Write Request Latency (Unit: microseconds) | |
Subscription and consumption | Accumulated Messages (Unit: counts) Note This metric indicates the total number of messages to be consumed in the current subscription across all shards. |
Consumption Latency (unit:seconds) Note This metric indicates the maximum consumption latency of the current subscription among all shards. | |
Subscription Latency (unit:seconds) Note This metric indicates the difference between the subscription offset and the current time. |
If you use the Kafka Consumer protocol to read data from DataHub, the Subscription Latency and Consumption Latency metrics cannot be used for monitoring.
View the monitoring data
On the Monitoring Details page, you can view the status of the resource quotas and the usage of each metric for the cloud service.
Log on to the CloudMonitor console.
In the left-side navigation pane, click Cloud Service Monitoring.
On the Cloud Service Monitoring page, click Analytics Computing. In the Analytics Computing section of the Cloud Service Monitoring page, move the pointer over DataHub and click DataHub.
On the DataHub page, find the desired resource and click Monitoring Charts in the Actions column to view the chart data.
NoteYou can view only the monitoring data that is generated in the last 30 days.
Configure an alert rule
On the monitoring page of DataHub, you can configure alert rules for resources. When an alert is triggered based on the configured alert rules, CloudMonitor sends an alert notification to you.
Log on to the CloudMonitor console.
In the left-side navigation pane, click Cloud Service Monitoring.
On the Cloud Service Monitoring page, click Analytics Computing. In the Analytics Computing section of the Cloud Service Monitoring page, move the pointer over DataHub and click DataHub.
On the monitoring page of DataHub, find the desired resource and click Alert Rules in the Actions column to go to the Alert Rules page.
Create an alert rule on the Alert Rules page.
On the Alert Rules page, click Create Alert Rule.
In the Create Alert Rule panel, configure parameters for the alert rule.
Click Confirm.
Create an alert rule on the monitoring page of DataHub.
In the upper-left corner of the monitoring page of DataHub, click Create Alert Rule.
In the Create Alert Rule panel, configure parameters for the alert rule.
Click Confirm.
NoteFor more information about how to configure parameters for an alert rule, see Create an alert rule.
View alert rules
On the monitoring page of DataHub, you can view all alert rules that are configured for resources.
Log on to the CloudMonitor console.
In the left-side navigation pane, click .
On the Cloud Service Monitoring page, click Analytics Computing. In the Analytics Computing section of the Cloud Service Monitoring page, move the pointer over DataHub and click DataHub.
In the upper-left corner of the monitoring page of DataHub, click View Alert Rules to view all alert rules.