Function Compute:Clean ApsaraMQ for RocketMQ message data using Function Compute

For example, you need to split the original message—a student list [Zhang San, male, Class 4|Li Si, female, Class 3|Wang Wu, male, Class 4]—into three separate messages and then push them to their respective destination services. To do this, use the content splitting operator. The split messages are as follows:

message:
    [Zhang San, male, Class 4]
message:
    [Li Si, female, Class 3]
message:
    [Wang Wu, male, Class 4]

The following figure shows the result.

For example, the following is a list of toothpaste information.

message:
[BrandA, toothpaste, $12.98, 100g
 BrandB, toothpaste, $7.99, 80g
 BrandC, toothpaste, $1.99, 100g]

You need to route the list to destination topics based on custom dynamic rules. The rules are described as follows.

• If a message starts with BrandA, send it to the BrandA-item-topic and BrandA-discount-topic topics.

• If a message starts with BrandB, send it to the BrandB-item-topic and BrandB-discount-topic topics.

• Send all other messages to Unknown-brand-topic.

The rules are described in JSON format as follows.

{
  "defaultTopic": "Unknown-brand-topic",
  "rules": [
    {
      "regex": "^BrandA",
      "targetTopics": [
        "BrandA-item-topic",
        "BrandA-discount-topic"
      ]
    },
    {
      "regex": "^BrandB",
      "targetTopics": [
        "BrandB-item-topic",
        "BrandB-discount-topic"
      ]
    }
  ]
}

This topic uses an example of enriching data from an IP address segment processing scenario. Assume that the access log for a service is as follows.

{
  "accountID": "164901546557****",
  "hostIP": "192.168.XX.XX"
}

You need to count the sources of IP addresses. The mapping relationship is stored in a MySQL database.

CREATE TABLE `tb_ip` (
    ->      `IP` VARCHAR(256) NOT NULL,
    ->     `Region` VARCHAR(256) NOT NULL,
    ->      `ISP` VARCHAR(256) NOT NULL,
    ->      PRIMARY KEY (`IP`)
    -> );

The processed message is as follows.

{
  "accountID": "164901546557****",
  "hostIP": "192.168.XX.XX",
  "region": "Beijing"
}

The following figure shows the result.

For example, the following is the registration information for a company's employees, which includes private information such as employee IDs and phone numbers.

Zhang San, Employee ID 1, 131 1111 1111
Li Si, Employee ID 2, 132 2222 2222
Wang Wu, Employee ID 3, 133 3333 3333

You need to mask the private employee information in the messages and then push them to the destination service. The result is as follows.

Zhang*, Employee ID *, *** **** ****
Li*, Employee ID *, *** **** ****
Wang*, Employee ID *, *** **** ****

The following figure shows the result.