Data Transmission Service:Configure a source database

Prerequisites

• ETL tasks can be created only in the following regions: China (Hangzhou), China (Shanghai), China (Qingdao), China (Beijing), China (Zhangjiakou), China (Shenzhen), China (Guangzhou), and China (Hong Kong).

• The source database is one of the following types: MySQL, PolarDB for MySQL, Oracle, PostgreSQL, DB2 for iSeries (AS/400), DB2 for LUW, PolarDB-X (Formerly DRDS), PolarDB for PostgreSQL, MariaDB, PolarDB for Oracle, SQL Server, or PolarDB-X 2.0.

• You have created a source database.

Procedure

1. Go to the Streaming ETL page.

   1. Log in to the DTS console.

   2. In the left-side navigation pane, click ETL.

2. In the upper-left corner, click the icon. In the Create Data Flow dialog box, enter a name in the Data Flow Name field, and set Development Method to DAG.

3. Click Confirm.

4. From the pane on the left, drag the Input/Dimension Table (MySQL) node to the canvas on the right.

5. Click the Input/dimension table MySQL-1 node on the canvas to configure the source database.

   1. Set the following parameters for the node.

      Parameter	Description
      Data source name	DTS automatically generates a name for the data source. We recommend specifying a descriptive name for easy identification. The name does not need to be unique.
      Region	Select the region where the source database is located. Note ETL tasks are available only in the following regions: China (Hangzhou), China (Shanghai), China (Qingdao), China (Beijing), China (Zhangjiakou), China (Shenzhen), China (Guangzhou), and China (Hong Kong).
      Instance list	Select the source database instance. To add a new instance, click Create Instance. For more information, see Instance Management.
      Node type	Select a node type. Stream Table Dimension Tables
      Convert format	This parameter is available only when you set Node type to Stream Table. Upsert Stream Append-Only Stream
      Database and table selection	Select the databases and tables that you want to transform. Note After you select the databases and tables, the Output Fields tab is displayed.

   2. On the Output Fields tab, in the Column Name column, select the required fields.

   3. Optional:If the selected node type is Stream Table, click the Time Attributes tab, set the following parameters, and complete the configuration for Input/Dimension Table MySQL-1.

      Parameter	Description
      Event time watermark field	Select the field that indicates the time when the data is generated.
      Event time watermark latency	Specify the latency for data generation.
      Processing time	Enter the field name for the processing time.