Managed Service for Prometheus helps you collect, store, and visualize monitoring data for Alibaba Cloud services, and provides integrated Grafana dashboards and alerts. This topic describes the Prometheus metrics for ApsaraMQ for Kafka and explains how to view them.
Metrics
The following table describes the available Prometheus monitoring metrics.
Type | Parameter | Description | Unit |
Instance | instance_message_input | Inbound message throughput for the instance (production traffic). | bytes/s |
instance_message_output | Outbound message throughput for the instance (consumption traffic). | bytes/s | |
instance_reqs_input | The rate of produce requests for the instance. | requests/s | |
instance_message_num_input | The rate of messages produced for the instance. | messages/s | |
instance_reqs_output | The rate of consume requests for the instance. | requests/s | |
instance_disk_capacity | Disk usage of the instance. | % | |
instance_tcp_num | Number of TCP connections per node. | count | |
instance_tcp_num_sum | Total number of TCP connections across all nodes in the instance. | count | |
instance_public_tcp_num | Number of Internet TCP connections per node. | count | |
instance_public_tcp_num_sum | Total number of Internet TCP connections across all nodes in the instance. | count | |
Topic | topic_message_input | Inbound message throughput for the topic (production traffic). | bytes/s |
topic_message_output | Outbound message throughput for the topic (consumption traffic). | bytes/s | |
topic_reqs_input | The rate of produce requests for the topic. | requests/s | |
topic_reqs_output | The rate of consume requests for the topic. | requests/s | |
topic_message_num_input | The rate of messages produced for the topic. | messages/s | |
Consumer group | message_accumulation | Total number of accumulated messages. | messages |
message_accumulation_onetopic | Number of accumulated messages per topic. | messages | |
rebalance_generation | Number of consumer group rebalances. | count | |
group_message_num_output | Total consumption rate. | messages/s | |
group_message_num_output_onetopic | Consumption rate per topic. | messages/s | |
group_message_num_output_onetopic_onepartition | Consumption rate per partition. | messages/s |
View data in the Kafka console
Log in to the ApsaraMQ for Kafka console. On the Overview page, in the Resource Distribution section, select a region.
On the Instances page, click the name of the instance that you want to manage.
In the left-side navigation pane, choose .
On the Prometheus Monitoring page, select a time range in the upper-right corner to view the monitoring data.
To view Prometheus monitoring data for a specific topic or consumer group, navigate to the details page of the topic or consumer group and click the Prometheus Monitoring tab.
View data in the Grafana console
Log in to the . In the left-side navigation pane, click Workspace Management.
On the Workspace Management page, click the URL next to the target workspace to open Grafana.
To view the monitoring data, follow the steps for your Grafana version.
Grafana 9.x
In the left-side navigation pane of Grafana, click the
icon, and then click Browse.On the Browse tab, click a monitoring dashboard in the target folder to view all of its charts.
For example, to view the dashboard for an instance in the China (Hangzhou) region, find the folder with the prefix
cloud-product-prometheus_cn-hangzhouand click kafka-instance.
Grafana 10.x
On the Grafana homepage, click the
icon in the upper-left corner.In the left-side navigation pane, select Dashboards, and then click a monitoring dashboard in the target folder to view all of its charts.
For example, to view the dashboard for an instance in the China (Hangzhou) region, find the folder with the prefix
cloud-product-prometheus_cn-hangzhouand click kafka-instance.
FAQ
Obtain dashboard metric data
Log on to the ARMS console by using your Alibaba Cloud account.
In the left-side navigation pane, click Integration Center.
In the search box on the Integration Center page, enter
Kafkaand click the search icon.From the search results, select the cloud service that you want to integrate (for example, Alibaba Cloud Kafka Message Queue Service). For more information about the integration, see Step 1: Integrate the monitoring data of an Alibaba Cloud service.
NoteTo obtain metric data for Message Queue for Apache Kafka serverless instances, you must enable Advanced Monitoring Metrics in the Configuration Information section during the integration. Otherwise, only metrics for non-serverless instances will be available.
After the integration is complete, click Provisioning in the left-side navigation pane.
On the Provisioning page, click the Alibaba Cloud Service Region Environment tab.
In the Alibaba Cloud Service Region Environment list, click the name of the target environment to go to the environment details page.
On the Component Management tab, in the Basic Information section, click the region next to Prometheus Instance.
On the Setting tab, you can find different data access methods.
Integrate with a self-managed Grafana
All metric data from ApsaraMQ for Kafka is saved to your Alibaba Cloud Managed Service for Prometheus. You can use the APIs provided by Managed Service for Prometheus to integrate the metric data from the ApsaraMQ for Kafka dashboards into your self-managed local Grafana.
For more information, see Use an HTTP API endpoint to connect Grafana or a self-managed application to Prometheus for data access.
Before integrating the data, ensure that Managed Service for Prometheus is integrated with Alibaba Cloud Kafka Message Queue Service in the same region as your ApsaraMQ for Kafka instance.