Dataphin:Configure ArgoDB input widget

Limits

The ArgoDB input widget supports ArgoDB tables in orc, parquet, text, holodesk, rc, and seq formats. Transactional tables in ORC format are not supported.

Prerequisites

• An ArgoDB data source has been created. For more information, see Create an ArgoDB data source.

• The account used to configure the ArgoDB input widget must have read-through permission for the data source. If you do not have the required permission, request it. For more information, see Request data source permission.

Procedure

1. On the Dataphin home page, select Development > Data Integration from the top menu bar.

2. In the top menu bar of the integration page, select Project (Dev-Prod mode requires selecting an environment).

3. In the left-side navigation pane, click Batch Pipeline. Then, in the Batch Pipeline list, click the offline pipeline you want to develop to open its configuration page.

4. Click the Component Library in the upper right corner of the page to open the Component Library panel.

5. In the Component Library panel's left-side navigation pane, select Input. Find the ArgoDB widget in the input widget list on the right and drag it to the canvas.

6. Click the icon on the ArgoDB input widget card to open the ArgoDB Input Configuration dialog box.

7. In the Argodb Input Configuration dialog box, configure the parameters.

   Parameter	Description
   Step Name	The name of the ArgoDB input widget. Dataphin automatically generates a step name, which you can modify as needed. Naming rules: It can only contain Chinese characters, letters, underscores (_), and numbers. It cannot exceed 64 characters.
   Datasource	The drop-down list displays all ArgoDB-type data sources in Dataphin, including those you have read-through permission for and those you do not. Click the icon to copy the data source name. For data sources you do not have read-through permission for, click Request next to the data source to request permission. For more information, see Request data source permission. If no ArgoDB-type data source exists, click Create Data Source to create one. For more information, see Create an ArgoDB data source.
   Table	Select the table to integrate. Click the icon to copy the table name.
   Partition	If the source table is partitioned, specify the partition information, such as state_date=’20190101’. You can also use parameters for daily incremental reads, such as state_date=${bizdate}.
   File Encoding	Select the encoding format based on your data. Supported formats: UTF-8 and GBK.
   Compression Format	Optional. If the file is compressed, select the compression format so that Dataphin can decompress it.
   Field Separator	The delimiter used to separate fields when writing to the target data source. Default: \u0001.
   Output Fields	Displays all fields of the selected table. To exclude fields from downstream widgets, delete them: Note When the compute engine is ArgoDB, the output fields of the ArgoDB input widget support viewing the classification and grading of fields. Non-ArgoDB compute engines do not support this. To delete a few fields, click the icon in the operation column. To delete many fields at once, click Field Management, select the fields, and then click the icon to move them to the unselected list.

8. Click Confirm.