Function Compute:Use Function Compute to cleanse message data in RocketMQ

For example, you need to split the original student list message [Jack, Male, Class 4|Alice, Female, Class 3|John, Male, Class 4] into three separate messages, and then send these three messages to respective destination services. To implement this, you can use the content splitting operator. The split messages are as follows:

message:
    [Jack, Male, Class 4]
message:
    [Alice, Female, Class 3]
message:
    [John, Male, Class 4]

The following figure shows the process.

The following message contains information about toothpaste of three brands:

message:
[BrandA, toothpaste, $12.98, 100g
 BrandB, toothpaste, $7.99, 80g
 BrandC, toothpaste, $1.99, 100g]

The list needs to be sent to destination topics based on the custom dynamic rules. The following items describe the rules:

• Send the messages that start with BrandA to the BrandA-item-topic and BrandA-discount-topic topics.

• Send the messages that start with BrandB to the BrandB-item-topic and BrandB-discount-topic topics.

• Send other messages to the Unknown-brand-topic topic.

The following sample code shows the JSON format of the rules:

{
  "defaultTopic": "Unknown-brand-topic",
  "rules": [
    {
      "regex": "^BrandA",
      "targetTopics": [
        "BrandA-item-topic",
        "BrandA-discount-topic"
      ]
    },
    {
      "regex": "^BrandB",
      "targetTopics": [
        "BrandB-item-topic",
        "BrandB-discount-topic"
      ]
    }
  ]
}

In this example, a CIDR block is enriched. The following sample code provides an example of the access logs of a service:

{
  "accountID": "164901546557****",
  "hostIP": "192.168.XX.XX"
}

The following sample code provides an example on how to query the source of the IP address and store the mapping relationship in a MySQL database:

CREATE TABLE `tb_ip` (
    ->      `IP` VARCHAR(256) NOT NULL,
    ->     `Region` VARCHAR(256) NOT NULL,
    ->      `ISP` VARCHAR(256) NOT NULL,
    ->      PRIMARY KEY (`IP`)
    -> );

The following sample code provides an example of processed messages:

{
  "accountID": "164901546557****",
  "hostIP": "192.168.XX.XX",
  "region": "beijing"
}

The following figure shows the process.

The following message contains the registration information about the employees of a company.

Zhang San, Employee ID 1, 131 1111 1111
Li Si, Employee ID 2, 132 2222 2222
Wang Wu, Employee ID 3, 133 3333 3333

The names, IDs, and phone numbers of employees in the preceding message are confidential. Therefore, you need to mask the names, IDs, and phone numbers before you send the message to the destination service. The following sample code provides an example:

Ja*, Employee ID *, ***********
Ma*, Employee ID *, ***********
Dav*, Employee ID *, *********** 

The following figure shows the process.