Managed Service for Prometheus:Import monitoring data from a Prometheus instance to MaxCompute

Prerequisites

• A Prometheus instance is created. For more information, see the following:

  • Monitor an ACK cluster

  • Monitor an Alibaba Cloud service

  • Monitor ECS instances

• An Apsara MQ for Kafka instance is created and a topic is created. For more information, see Overview.

• Function Compute (FC) is activated. For more information, see Step 1: Activate Function Compute.

• EventBridge is activated. For more information, see Activate EventBridge and grant permissions to a RAM user.

  Note

  This feature requires EventBridge (commercially available since June 3, 2025). Refer to EventBridge fees for billing details.

Billing

When you import data to MaxCompute, a Function Compute (FC) service is created. The prefix of the service is {task_name}_SINK_FC_TO_MAXCOMPUTE. Function Compute (FC) is used to write the monitoring data to MaxCompute. Therefore, a Function Compute fee is charged. Monitoring data is sent to Function Compute (FC) in batches. Therefore, the less number of times Function Compute (FC) is called, the less fee is charged. You can log on to the Function Compute console to view the status of the current Function Compute resource.

Step 1: Prepare MaxCompute resources

1. Read the MaxCompute documentation and choose any method to connect to a MaxCompute project. For more information, see Select a connection tool.

2. Determine the table schema: Map a column in the table schema to the tag name of the metric exported from Prometheus. If no metric value matches a column, a null value is inserted to the column. If multiple metrics are exported, the corresponding column name must be a union of the tag names of all metrics.

{
	"__name__": "metric1",
	"cluster_id": "***",
	"host": "***",
	"node_id": "***",
	"job": "***",
	"value": 347.51300048828125,
	"timestamp": 1703211584056
}

{
	"__name__": "metric2",
	"cluster_id": "***",
	"job": "***",
  "instance": "****",
  "cpu": "1",
	"value": 1.0,
	"timestamp": 1703211584056
}

CREATE TABLE metric (
  __name__ 		VARCHAR(50) NOT NULL,
  cluster_id 	VARCHAR(50),
  host 				VARCHAR(50),
  node_id 		VARCHAR(50),
  job 				VARCHAR(50),
  instance 		VARCHAR(50),
  cpu 				VARCHAR(50),
  __value__ 			DOUBLE,
  timestamp		BIGINT
);

Step 2: Create a data delivery task

1. Log on to the Managed Service for Prometheus console.

2. In the left navigation pane, click Data Delivery.

3. On the Data Delivery page, select a region in the top navigation bar and click Create Task.

4. In the dialog box that appears, set the Task Name and Task Description parameters, and click OK.

5. On the Edit Task page, configure the data source and event target.

   1. Click + Add Data Source, set the parameters, and then click OK. The following table lists the parameters.

      Parameter	Description	Example
      Prometheus Instance	The Prometheus instance whose data you want to deliver.	c78cb8273c02*****
      Data Filtering	The label of the metric to be filtered. Regular expressions are supported. Use line breaks to separate multiple conditions. The data can be delivered only when the relationship among the conditions is Logical AND.	__name__=AliyunEcs_CPUUtilization|AliyunEcs_memory_usedutilization regionId=cn-hangzhou id=i-2ze0mxp.*
      Data Labeling	The label you add to metric data to be delivered. Use line breaks to separate multiple labels.	deliver_test_key1=ssss deliver_test_key2=yyyy

   2. Click Add Target, set the Destination Type parameter to MaxCompute, specify the required information, and then click OK.

6. On the Edit Task page, click OK and Save.

Step 3: Verify that monitoring data is imported to MaxCompute

In the SQL code editor, enter the following SQL statement to query data in the metric table and click Run. On the Run Result tab, you can view the query result.

select * from metric limit 20;