All Products
Search

This Product

    Container Service for Kubernetes:Cloud-controller-manager monitoring metrics and dashboards

    Document Center

    Container Service for Kubernetes:Cloud-controller-manager monitoring metrics and dashboards

    Last Updated:Jul 06, 2026

    The cloud-controller-manager add-on lets Kubernetes core components interact with the cloud provider through the Kubernetes API. This topic lists its metrics, explains how to use the monitoring dashboards, and analyzes common metric anomalies.

    Before you begin

    Access the dashboards

    See View monitoring dashboards for control plane components.

    Metric list

    The cloud-controller-manager component exposes the following metrics.

    Metric

    Type

    Description

    ccm_slb_latency_ms

    Histogram

    Classic Load Balancer (CLB) synchronization latency. Unit: ms.

    Bucket thresholds: {100, 200, 300, 400, 500, 600, 700, 800, 900, 1000,1500, 2000, 3000, 4000, 5000, 6000, 7000, 8000, 9000, 10000}.

    ccm_node_latency_ms

    Histogram

    Node synchronization latency. Unit: ms.

    Bucket thresholds: {100, 200, 300, 400, 500, 600, 700, 800, 900, 1000,1500, 2000, 3000, 4000, 5000, 6000, 7000, 8000, 9000, 10000}.

    ccm_route_latency_ms

    Histogram

    Route synchronization latency. Unit: ms.

    Bucket thresholds: {100, 200, 300, 400, 500, 600, 700, 800, 900, 1000,1500, 2000, 3000, 4000, 5000, 6000, 7000, 8000, 9000, 10000}.

    workqueue_adds_total

    Counter

    Total events added to the Workqueue.

    workqueue_depth

    Gauge

    Current Workqueue depth. A sustained high value indicates the controller cannot process tasks fast enough, causing a backlog.

    workqueue_queue_duration_seconds_bucket

    Histogram

    Time an item waits in the Workqueue. Bucket thresholds: {10-8, 10-7, 10-6, 10-5, 10-4, 10-3, 10-2, 10-1, 1, 10}. Unit: seconds.

    memory_utilization_byte

    Gauge

    Memory utilization. Unit: bytes.

    cpu_utilization_core

    Gauge

    CPU utilization. Unit: cores.

    resource_utilization_level

    Gauge

    Resource utilization level.

    • resource: The resource type. Valid values: cpu and memory.

    • utilization_level: The utilization level. Valid values: high (utilization ≥ 80%) and normal (utilization < 80%).

    • container: The target container. Valid values: kube-apiserver, kube-scheduler, kube-controller-manager, cloud-controller-manager, and etcd.

    rest_client_requests_total

    Counter

    Total HTTP requests by status code, method, and host.

    rest_client_request_duration_seconds_bucket

    Histogram

    HTTP request latency by verb and URL.

    Note

    The following resource utilization metrics are no longer in use. Remove any alerts or monitoring rules that rely on these metrics:

    • cpu_utilization_ratio: CPU utilization.

    • memory_utilization_ratio: Memory utilization.

    Dashboards

    PromQL-based panels visualize the component metrics.

    CCM

    Observability displayccm1

    Panel details

    Panel name

    PromQL

    Description

    Route synchronization latency

    histogram_quantile($quantile, sum(rate(ccm_route_latencies_duration_milliseconds_bucket[$interval])) by (verb, le))

    Route synchronization latency. Unit: ms.

    Node synchronization latency

    histogram_quantile($quantile, sum(rate(ccm_node_latencies_duration_milliseconds_bucket[$interval])) by (verb, le))

    Node synchronization latency. Unit: ms.

    CLB (Classical Load Balancer) Synchronization Latency

    histogram_quantile($quantile, sum(rate(ccm_slb_latencies_duration_milliseconds_bucket[$interval])) by (verb, le))

    CLB synchronization latency. Unit: ms.

    Queue

    Observability displayccm2

    Panel details

    Panel name

    PromQL

    Description

    Workqueue add rate

    sum(rate(workqueue_adds_total{job="ack-cloud-controller-manager"}[$interval])) by (name)

    Rate of events added to the Workqueue.

    Workqueue depth

    workqueue_depth{job="ack-cloud-controller-manager"}

    Average rate of change in Workqueue depth.

    Workqueue processing latency

    histogram_quantile($quantile, sum(rate(workqueue_queue_duration_seconds_bucket{job="ack-cloud-controller-manager"}[$interval])) by (name, le))

    Time an item waits in the Workqueue.

    Resources

    Observability display

    image

    Panel details

    Panel name

    PromQL

    Description

    Memory usage

    memory_utilization_byte{container="cloud-controller-manager"}

    Memory utilization. Unit: bytes.

    CPU Usage

    cpu_utilization_core{container="cloud-controller-manager"}*1000

    CPU utilization. Unit: millicore.

    Memory utilization level

    • resource_utilization_level{resource="memory",container="cloud-controller-manager",utilization_level="high"}

    • resource_utilization_level{resource="memory",container="cloud-controller-manager",utilization_level="normal"}

    • If resource_utilization_level{utilization_level="high",...} is 1, the container resource utilization level is ≥ 80%.

    • If resource_utilization_level{utilization_level="normal",...} is 1, the container resource utilization level is < 80%.

    CPU utilization level

    • resource_utilization_level{resource="cpu",container="cloud-controller-manager",utilization_level="high"}

    • resource_utilization_level{resource="cpu",container="cloud-controller-manager",utilization_level="normal"}

    Kube API

    Observability displayccm4

    Panel details

    Panel name

    PromQL

    Description

    Kube API request QPS

    • sum(rate(rest_client_requests_total{job="ack-cloud-controller-manager",code=~"2.."}[$interval])) by (method,code)

    • sum(rate(rest_client_requests_total{job="ack-cloud-controller-manager",code=~"3.."}[$interval])) by (method,code)

    • sum(rate(rest_client_requests_total{job="ack-cloud-controller-manager",code=~"4.."}[$interval])) by (method,code)

    • sum(rate(rest_client_requests_total{job="ack-cloud-controller-manager",code=~"5.."}[$interval])) by (method,code)

    HTTP request QPS from cloud-controller-manager to kube-apiserver, by method and status code.

    Common metric anomalies

    Classic Load Balancer (CLB) synchronization latency

    Normal conditions

    Abnormal conditions

    Description

    Recommendations

    The synchronization latency of CLB (Classical Load Balancer) is ≤ 10 s.

    The synchronization latency of CLB (Classical Load Balancer) exceeds 10 s.

    CLB synchronization is taking too long.

    Check the Service for abnormal events.

    Workqueue depth

    Normal conditions

    Abnormal conditions

    Description

    Recommendations

    The workqueue depth is ≤ 10.

    The workqueue depth exceeds 10.

    Large backlog of items awaiting synchronization.

    An overly long queue slows Service synchronization. Reduce the frequency of changes to nodes, Pods, and Services in the cluster.

    Related documentation

    For other control plane components, see kube-apiserver monitoring metrics, etcd monitoring metrics, kube-scheduler monitoring metrics, and kube-controller-manager monitoring metrics.