This topic describes the metrics for the Elastic Algorithm Service (EAS) provided by Machine Learning Platform for AI (PAI) for online inference.
- Set the Namespace parameter to acs_learn.
- Set the Period parameter to an integral multiple of 60s. The default value is 60s.
| Metric | Unit | Metric | Dimensions | Statistics |
|---|---|---|---|---|
| CPUConsumption | count | cpu_core_usage | userId and serviceName | Average and Maximum |
| GPUUtilization | % | gpu_util | userId and serviceName | Average and Maximum |
| MemoryComsumption | byte | memory_rss | userId and serviceName | Average, Maximum, and Minimum |
| QueryPerSecondTotal | frequency | qps_total | userId and serviceName | Value, Average, and Maximum |
| ResponsePerSecondWithStatusCode2xx | frequency | rps_status_2xx | userId and serviceName | Average, Maximum, Value, and Minimum |
| 2xxResponseRatio | % | rps_status_2xx_ratio | userId and serviceName | Average, Minimum, Maximum, and Value |
| ResponsePerSecondWithStatusCode4xx | frequency | rps_status_4xx | userId and instanceId | Average, Maximum, and Value |
| 4xxResponseRatio | % | rps_status_4xx_ratio | userId and serviceName | Average, Maximum, Minimum, and Value |
| ResponsePerSecondWithStatusCode5xx | frequency | rps_status_5xx | userId and serviceName | Average, Maximum, and Value |
| 5xxResponseRatio | % | rps_status_5xx_ratio | userId and serviceName | Average, Maximum, Minimum, and Value |
| ResponseTime | microseconds | rt | userId and serviceName | Average, Maximum, and Minimum |
| IngressTraffic | bps | traffic_in | userId and serviceName | Average, Maximum, Minimum, and Value |
| EgressTraffic | bps | traffic_out | userId and serviceName | Average, Maximum, Minimum, and Value |