Mengambil daftar peringatan kluster GPU.
Deskripsi operasi
Setelah menginstal Komponen pada Kluster ACK target:
Saat Kluster dikelola untuk pertama kalinya, Komponen diinstal pada semua Instance ECS yang saat ini berada di Kluster. Jika Kluster memiliki lebih dari 50 node, hanya 50 node pertama yang diproses dalam Batch pertama.
Konsol sistem operasi secara berkala memeriksa status penskalaan Kluster yang dikelola. Saat Instance ECS baru ditambahkan ke Kluster, Konsol secara otomatis menginstal Komponen tersebut tanpa intervensi pengguna.
Coba sekarang
Test
RAM authorization
Sintaks permintaan
GET /api/v1/aiTopology/topology/listAlarmRecord HTTP/1.1
Parameter permintaan
|
Parameter |
Type |
Required |
Description |
Example |
| alarmTime |
string |
No |
Kueri berdasarkan titik pengatur waktu tertentu, seperti "2025-08-22 18:16:25". Kueri berdasarkan rentang waktu menggunakan format "start,end", seperti "2025-08-22 18:16:25,2025-08-23 18:16:25". |
"2025-08-22 18:16:25,2025-08-23 18:16:25" |
| alarmCluster |
string |
No |
Kueri berdasarkan kluster tertentu, seperti "cluster1". Untuk mengkueri beberapa kluster, pisahkan dengan koma: "cluster1,cluster2,cluster3". |
"cluster1" |
| alarmTask |
string |
No |
Kueri berdasarkan tugas tertentu, seperti "task1". Untuk mengkueri beberapa tugas, pisahkan dengan koma: "task1,task2,task3". |
task id |
| current |
integer |
Yes |
Nomor halaman saat ini untuk paginasi. |
1 |
| pageSize |
integer |
Yes |
Jumlah entri per halaman untuk paginasi. |
10 |
| status |
string |
No |
Filter berdasarkan status tugas, seperti blocking, berjalan, exited, atau restart. |
Running |
| alarmType |
string |
No |
Filter berdasarkan tipe anomali, seperti akses memori GPU di luar batas atau tugas hang. |
cuda error |
| alarmExtInfo |
string |
No |
Filter anomali berdasarkan ID instans atau kontainer. |
instance id |
Elemen respons
|
Element |
Type |
Description |
Example |
|
object |
Skema tanggapan. |
||
| code |
string |
Nilainya adalah "Success" atau "Sysom.ServerError". |
Success or Sysom.ServerError |
| data |
array<object> |
Daftar data peringatan. |
|
|
object |
Node data. |
||
| alarmCluster |
string |
Kluster tempat peringatan dipicu. |
cluster1 |
| alarmExtInfo |
any |
Informasi tambahan mengenai peringatan. |
{ error_node_gpu, error_pod, task_pod_list, error_type, kernel, } |
| alarmId |
string |
ID unik peringatan. |
746d13f8-9662-4441-b76b-a8ed8d485195 |
| alarmLog |
string |
Log event yang terkait dengan peringatan. |
cuda OOM:xxxxx |
| alarmTask |
string |
ID tugas tempat anomali terjadi. |
task job id |
| alarmTime |
string |
Tanggal dan pengatur waktu saat peringatan dipicu. |
2025-08-22 18:16:25 |
| alarmTopology |
any |
Snapshot topologi. |
daftar topologi, misalnya. "alarmTopology": { "nodes": [ { "gpu_list": [ { "values": { "Basic": [ { "value": "1", "key": "Gpu Number\n" } ], "Metric": [ { "value": "50", "key": "gpu_util(%)\n" } ], "Exception": [ { "value": "NCCL HANG", "key": "error0" } ] }, "name": "GPU1", "style": { "fill": "#e94242\n", "opacity": "0.1" }, "id": "6cc37fbc" } ], "values": { "Basic": [ { "value": "i-xxxxxx", "key": "instance" } ], "Metric": [ { "value": "value of metrics 1", "key": "name of metric 1" } ], "Exception": [ { "value": "NCCL HANG", "key": "error0" } ] }, "name": "i-xxxxxx\n", "style": { "fillOpacity": "0.5", "fill": "#e94242\n" }, "id": "975fbcb0" } ], "edges": [ { "src_id": "00534a88", "values": { "Basic": [ { "value": "v2.22.3\n", "key": "NCCL Version\n" } ], "Metric": [ { "value": "10000", "key": "Recv Msg Count" } ], "Exception": [ { "value": "NCCL HANG", "key": "error0" } ] }, "dst_id": "260525e9", "style": { "opacity": "0.1", "lineWidth": "1", "selectedStyle": "\"{\\\"opacity\\\": 1, \\\"lineWidth\\\": 1}\"\n", "stroke": "#e94242" }, "type": "GPU" } ] }, |
| alarmType |
string |
Data deret waktu untuk peringatan. |
cuda OOM |
| status |
string |
Status tugas. |
running、blocking、restart、exited、failed |
| uid |
string |
UUID akun cloud. |
1234123412352311 |
| message |
string |
Saat code bukan "Success", Paket berisi informasi error. |
server error |
| requestId |
string |
ID permintaan. |
real request ID |
| total |
string |
Jumlah total rekaman yang dikembalikan. |
10 |
Contoh
Respons sukses
JSONformat
{
"code": "Success or Sysom.ServerError",
"data": [
{
"alarmCluster": "cluster1",
"alarmExtInfo": "{\nerror_node_gpu, \nerror_pod, \ntask_pod_list, \nerror_type, \nkernel, \n}",
"alarmId": "746d13f8-9662-4441-b76b-a8ed8d485195",
"alarmLog": "cuda OOM:xxxxx",
"alarmTask": "task job id",
"alarmTime": "2025-08-22 18:16:25",
"alarmTopology": "topology data,e.g.\n \"alarmTopology\": {\n \"nodes\": [\n {\n \"gpu_list\": [\n {\n \"values\": {\n \"Basic\": [\n {\n \"value\": \"1\",\n \"key\": \"Gpu Number\\n\"\n }\n ],\n \"Metric\": [\n {\n \"value\": \"50\",\n \"key\": \"gpu_util(%)\\n\"\n }\n ],\n \"Exception\": [\n {\n \"value\": \"NCCL HANG\",\n \"key\": \"error0\"\n }\n ]\n },\n \"name\": \"GPU1\",\n \"style\": {\n \"fill\": \"#e94242\\n\",\n \"opacity\": \"0.1\"\n },\n \"id\": \"6cc37fbc\"\n }\n ],\n \"values\": {\n \"Basic\": [\n {\n \"value\": \"i-xxxxxx\",\n \"key\": \"instance\"\n }\n ],\n \"Metric\": [\n {\n \"value\": \"value of metrics 1\",\n \"key\": \"name of metric 1\"\n }\n ],\n \"Exception\": [\n {\n \"value\": \"NCCL HANG\",\n \"key\": \"error0\"\n }\n ]\n },\n \"name\": \"i-xxxxxx\\n\",\n \"style\": {\n \"fillOpacity\": \"0.5\",\n \"fill\": \"#e94242\\n\"\n },\n \"id\": \"975fbcb0\"\n }\n ],\n \"edges\": [\n {\n \"src_id\": \"00534a88\",\n \"values\": {\n \"Basic\": [\n {\n \"value\": \"v2.22.3\\n\",\n \"key\": \"NCCL Version\\n\"\n }\n ],\n \"Metric\": [\n {\n \"value\": \"10000\",\n \"key\": \"Recv Msg Count\"\n }\n ],\n \"Exception\": [\n {\n \"value\": \"NCCL HANG\",\n \"key\": \"error0\"\n }\n ]\n },\n \"dst_id\": \"260525e9\",\n \"style\": {\n \"opacity\": \"0.1\",\n \"lineWidth\": \"1\",\n \"selectedStyle\": \"\\\"{\\\\\\\"opacity\\\\\\\": 1, \\\\\\\"lineWidth\\\\\\\": 1}\\\"\\n\",\n \"stroke\": \"#e94242\"\n },\n \"type\": \"GPU\"\n }\n ]\n },",
"alarmType": "cuda OOM",
"status": "running、blocking、restart、exited、failed",
"uid": "1234123412352311"
}
],
"message": "server error",
"requestId": "real request ID",
"total": "10"
}
Kode kesalahan
|
HTTP status code |
Error code |
Error message |
Description |
|---|---|---|---|
| 400 | Sysom.ServerError | Server error, please correct the code according to the error message. %s. |
Lihat Error Codes untuk daftar lengkap.
Catatan rilis
Lihat Release Notes untuk daftar lengkap.