Object Storage Service:Configure OSS event notifications with SMQ

Scenario

A company creates a bucket named srcbucket in the China (Hangzhou) region. This bucket contains log objects with the log/ prefix and customer case image objects with the destdir/ prefix.

srcbucket
    └── log/
       ├── date1.txt
       ├── date2.txt
       ├── date3.txt
       ├── .......
    └── destdir/       
       ├── photo1.jpg
       ├── photo2.jpg
       ├── ......

A subsidiary needs to replicate new log and image objects from srcbucket in real time, including any creations, deletions, or modifications. The replication destination is a bucket named destbucket, which is owned by the parent company in the UK (London) region. The company also wants to notify all employees of object changes that match the log/ and destdir/ prefixes in both srcbucket and destbucket.

To meet these requirements, configure a cross-region replication (CRR) rule for srcbucket and set up event notifications for both srcbucket and destbucket.

Step 1: Create queues

1. Log on to the SMQ console.

2. In the left-side navigation pane, choose Queue Model > Queues.

3. In the top navigation bar, select the China (Hangzhou) region.

4. On the Queues page, click Create Queue. Set the queue name to myqueue1 and keep the default settings for the other parameters.

5. Click OK.

6. Repeat the preceding steps to create a queue named myqueue2 in the UK (London) region.

Step 2: Configure cross-region replication

1. Log on to the OSS console.

2. Click Buckets, and then click srcbucket.

3. In the left-side navigation pane, choose Data Management > CRR.

4. On the CRR page, click CRR.

5. In the CRR panel, configure the following parameters and click OK.

   Parameter	Description
   Destination Bucket	Select UK (London) as the region and destbucket as the bucket.
   Objects to Replicate	Select Objects with Specified Prefix and add the prefixes destdir/ and log/.
   Replication Policy	Select Add/Delete/Change Sync.
   Replicate Historical Data	Select Copy.
   RAM Role Name	Select the RAM role for cross-region replication.

Step 3: Configure event notifications

1. Log on to the OSS console.

2. Click Buckets. Follow these steps to configure event notifications for both srcbucket and destbucket:

   1. In the left-side navigation pane, choose Data Processing > Event Notification.

   2. On the Event Notification page, click Create Rule.

   3. In the Create Rule panel, configure the parameters as described in the following table, and then click OK.

      Parameter	Source (srcbucket)	Destination (destbucket)
      Rule Name	Set the rule name to notification1.	Set the rule name to notification2.
      Event Type	Select PutObject, CopyObject, DeleteObject, and DeleteObjects.	Select ObjectReplication:ObjectCreated, ObjectReplication:ObjectRemoved, and ObjectReplication:ObjectModified.
      Resource Description	Select Prefix and Suffix. Add the prefixes log/ and destdir/.	Select Prefix and Suffix. Add the prefixes log/ and destdir/.
      Endpoint	Select Queue. For the queue name, enter myqueue1, which you created in Step 1.	Select Queue. For the queue name, enter myqueue2, which you created in Step 1.

The event notification rules take effect about 10 minutes after you configure them.

Step 4: Create subscriptions and receive messages

When a matching event occurs, SMQ automatically creates a topic. The topic name follows the format mns-en-topics-[Product]-[RuleName]-[Timestamp], for example, mns-en-topics-oss-notification1-1700098799. You must create a subscription for this topic and specify a receiver endpoint.

1. Navigate to the subscription page.

   1. Log on to the SMQ console.

   2. In the left-side navigation pane, click Topics.

   3. In the top navigation bar, select the China (Hangzhou) region.

   4. Find the topic that SMQ automatically created and click View Subscriptions in the Actions column.

2. Create a subscription.

   1. On the topic details page, click the Subscriptions tab, and then click Create Subscription.

   2. On the Create Subscription page, create a subscription for the source bucket, srcbucket. Set Subscription Name to mysubscription1, Push Type to Queue, and Receiver Endpoint to myqueue1. Keep the default settings for the other parameters.

   3. Click OK.

3. Repeat these steps in the UK (London) region to create a subscription named mysubscription2 for the destination bucket, destbucket. Select Queue as the push type and specify myqueue2 as the receiver endpoint. Keep the default settings for the other parameters.

4. Receive notifications.

   1. In the left-side navigation pane, click Queues.

   2. In the Actions column for the target queue myqueue1, choose More.

   3. In the Receive Message section, click Receive Message in the upper-right corner.

      You can now receive event notifications for the creation, modification, and deletion of objects that match the log/ and destdir/ prefixes in srcbucket.

   4. Repeat these steps for the queue myqueue2 to receive notifications from the destination bucket, destbucket. After the configuration is complete, you will receive event notifications when objects in destbucket are created, overwritten, or deleted by the CRR rule.

   When you no longer need to receive event notifications, delete the corresponding event notification rules. Note that deleting a rule does not automatically delete the topic created for it. To avoid unnecessary charges, you must manually delete unused topics.