The field selection transform component allows you to selectively retain fields from upstream inputs. This topic guides you through the configuration process.
Procedure
In the top menu bar of the Dataphin homepage, choose Developer > Data Integration.
In the top menu bar of the integration page, select Project. (In Dev-Prod mode, you need to select Environment).
In the left-side navigation pane, click Batch Pipeline. In the Batch Pipeline list, click the offline pipeline that you want to develop to open its configuration page.
Click Component Library in the upper-right corner of the page to open the Component Library panel.
In the left-side navigation pane of the Component Library panel, select Transform. In the transform component list on the right, find the Field Selection component and drag it to the canvas.
Click and drag the
icon of the target upstream and downstream components to connect them to the current field selection component.Click the
icon in the field selection component card to open the Field Selection Configuration dialog box.In the Field Selection Configuration dialog box, configure the parameters.
Parameter
Description
Step Name
The name of the field selection transform component. Dataphin automatically generates a step name, but you can modify it based on your business scenario. The name must meet the following requirements:
It can contain only Chinese characters, letters, underscores (_), and numbers.
It can be up to 64 characters in length.
Input Fields
Displays the input fields based on the output of the upstream component.
Output Fields
Displays the output fields. Click Field Management:
Click the
icon to move Selected Input Fields to Unselected Input Fields.Click the
icon to move Unselected Input Fields to Selected Input Fields.
After the input fields are selected, the Output Fields area displays the following information:
Serial Number: The ordinal number of the corresponding input field.
Input Field Name, Input Field Type: The name (if the name includes a table name, the table name is also displayed) and type of the input field. These cannot be modified.
Output Field Name: The editable output field name, which defaults to the input field name. If the name includes a table name, it is displayed in the format
table_name.field_name. If the field name is empty, it is automatically filled with the input field name.Output Field Type: Supports conversion to different data types based on the input field's data type. For specific details, refer to the actual page display.
Actions: Click the delete icon in the Actions
column to delete an existing field.
Click Confirm to complete the property configuration of the Field Selection transform component.