edit-icon download-icon

Configure a data subscription channel

Last Updated: Dec 19, 2017

DTS can subscribe to RDS binlog, allowing you to view incremental data in real time and consume the data with built-in SDK. You can use the data subscription function for lightweight cache update, message notification, and real-time data synchronization with ETL logic.

At a high level, when using data subscription, you follow these steps:

  • Create a data subscription instance on the Data Transmission Service purchase page.
  • Configure a subscription channel to subscribe to an RDS instance in the DTS console.
  • Use DTS SDK to access the subscription channel for obtaining and consuming binlog.

This document describes how to configure a subscription channel to subscribe to an RDS instance in the DTS console.

Prerequisites

Data subscription applies the following restrictions:

  • The source instance only supports RDS for MySQL.
  • For MySQL 5.6, the binlog_row_image format of binlog must be Full.
  • The MySQL storage engine only supports myisam and innodb.
  • The MySQL character set only supports latin1, GBK, UTF-8, UTF8mb4, and binary.

Procedure

Before going ahead, make sure you have at least an available subscription instance, or you can purchase one through the Data Transmission Service purchase page. For more information, see Purchase DTS instances.

Follow these steps to configure a subscription channel in the DTS console.

  1. Log on to the Alibaba Cloud DTS console.

  2. Click Data subscription in the left-side navigation pane.

  3. Click Configure subscription channel under the target subscription instance.

  4. In the Select instance stage, complete the following configurations, and then click Authorize whitelist and enter into next step.

    • Subscription name: specifies the subscription instance according to your business requirements, or leave it as it is. The name is an alias of the subscription channel and is not required to be unique.
    • Instance type: specifies RDS instance.
    • RDS Instance ID: specifies the ID of the RDS instance which is subscribed to.
  5. In the Select subscription object stage, complete the following configurations, and click Save and pre-check.

    • Data to be subscribed: specifies Data update or Structure update or both.

      • Data update indicates DML (Data Manipulation Language, used to manipulate data itself), such as insert, delete, and update.
      • Structure update indicates DDL (Data Definition Language, used to define data structures), such as create table, drop table, and alter table.

      If you subscribe to structure change, DTS pulls all the structure changes on the RDS instance. The obtained structure changes can be filtered for SDK consumption as needed.

    • Subscription objects: specifies multiple databases or tables.

  6. Wait until the pre-check passes, and then click Close to start the subscription instance.

After the subscription instance is started, the subscription channel begins initializing. After initialization, you can View subscription data, or Subscribe to change data by using SDK.

Thank you! We've received your feedback.