Dataphin:Configure TDH Inceptor Input Component

Limits

The TDH Inceptor input component supports data tables in formats such as ORC, Parquet, text, RC, and SEQ, but does not support transactional tables in ORC format.

Prerequisites

• A TDH Inceptor data source must be created. For more information, see Create TDH Inceptor Data Source.

• The account used to configure the TDH Inceptor input component must have read-through permission for the data source. If you do not have this permission, request it. For more information, see Request Data Source Permission.

Procedure

1. On the Dataphin home page, select Development > Data Integration from the top menu bar.

2. On the integration page's top menu bar, select Project (Dev-Prod mode requires selecting an environment).

3. In the left-side navigation pane, click Batch Pipeline. In the Batch Pipeline list, click the offline pipeline you want to develop to open its configuration page.

4. Click the Component Library in the upper right corner of the page to open the Component Library panel.

5. In the Component Library panel's left-side navigation pane, select Input. Find the TDH Inceptor component in the list on the right and drag it to the canvas.

6. Click the icon on the TDH Inceptor input component card to open the TDH Inceptor Input Configuration dialog box.

7. In the TDH Inceptor Input Configuration dialog box, set the parameters.

   Parameter	Description
   Step Name	The name of the TDH Inceptor input component. Dataphin generates a default name that you can modify. The name must meet the following requirements: Can only contain Chinese characters, letters, underscores (_), and numbers. Cannot exceed 64 characters.
   Datasource	Lists all TDH Inceptor data sources in the current Dataphin instance, including those you do not have read-through permission for. Click the icon to copy the data source name. For data sources without read-through permission, click Request next to the data source to request permission. For more information, see Request Data Source Permission. If you do not have a TDH Inceptor data source, click Create Data Source to create one. For more information, see Create TDH Inceptor Data Source.
   Table	Select the source table for data synchronization. Click the icon to copy the selected table name.
   Partition	If the selected table is partitioned, enter the partition information, such as ds=${bizdate}.
   When Partition Does Not Exist	Select a policy to apply when the specified partition does not exist: Fail The Task: Terminate the task and mark it as failed. Succeed The Task Without Writing Data: The task runs successfully without writing data.
   File Encoding	Select the file encoding. Supported options: UTF-8 and GBK.
   Compression Format	Select the file compression format, such as zlib or hadoop-snappy.
   Field Separator	Enter the field separator for file storage. Default: comma (,).
   Output Fields	Displays all fields of the selected table. Delete any fields that you do not need to pass to downstream components: Note Field classification is available only when the compute engine is TDH Inceptor. Single Field Deletion Scenario: To delete individual fields, click the icon in the operation column. Batch Field Deletion Scenario: To delete multiple fields at once, click Field Management, select the fields in the Field Management dialog box, click the left shift icon to move them to the unselected list, and click Confirm.

8. Click Confirm to complete the configuration of the TDH Inceptor input component properties.