The LogicalTable input widget is designed to read data from logical tables, including logical fact tables, logical dimension tables, and logical aggregate tables, within Dataphin. When syncing data from Dataphin's logical tables to a data source, it is essential to configure the logical table information first. This topic describes the steps to configure the LogicalTable input widget.
Prerequisites
Ensure the following steps have been completed before you begin:
The current project is attached to an offline computing engine. For specific operations, see Create a general project.
A logical table has been created. For specific operations, refer to Standardized Modeling.
To configure the properties of the LogicalTable input widget, the account must have read-through permissions for the data table. Should the account lack these permissions, you must obtain them for the data table. For detailed instructions, see Request, renew, and release table permissions.
Procedure
On the Dataphin home page, select Development > Data Integration from the top menu bar.
On the integration page, select Project from the top menu bar (ensure the environment is set to Dev-Prod mode).
In the left-side navigation pane, click on the Batch Pipeline icon. From the Batch Pipeline list, select the offline pipeline you want to develop to access its configuration page.
Click Component Library in the upper-right corner of the page to open the Component Library panel.
In the left-side navigation pane of the Component Library panel, select Input. Then, in the input widget list on the right, locate the Logicaltable input widget and drag it onto the canvas.
Click the
icon on the LogicalTable input widget card to open the Logicaltable Input Configuration dialog box.In the Logicaltable Input Configuration dialog box, set the parameters.
Parameter
Description
Step name
The name of the LogicalTable input widget. Dataphin automatically generates a step name. You can also modify the name based on your business scenario. The naming conventions are as follows:
Only Chinese characters, letters, underscores (_), and digits are allowed.
The name cannot exceed 64 characters.
Data block
Select the data block where the logical table resides.
Logical table type
Select the type of the logical table. Logical table types include logical fact table, logical dimension table, and logical aggregate table.
For more information about logical fact tables, logical dimension tables, and logical aggregate tables, see Standardized modeling.
Logical table
Based on the selected logical table type, select the corresponding logical table.
The drop-down list of logical tables displays only the logical tables for which the current account has read-through permissions. You can also add other logical tables to the drop-down list in the following ways:
If you need to select a logical table for which you do not have permissions, request the required permissions for the logical table. For more information about how to request permissions for logical tables, see Request, renew, and release table permissions.
If you need to create a new logical table, click Create in the following figure and follow the instructions to create the logical table. For more information, see Standardized modeling.
Logical table output
You can select With associations or Without associations.
With associations: Outputs the associated tables of the current logical table.
Without associations: Outputs only the content of the selected logical table.
Output fields
The output field area displays all fields read from the logical table by the LogicalTable. You can click the Actions column's
icon to delete a field.On the Field Management page, all fields in the logical table are selected by default and displayed in the output fields preview area.
If you select an associated table node, all tables under the associated node are selected. You can select some tables under the associated table node and then click Invert Selection to select the remaining tables.
If you need to delete a field in the output fields preview area, you can deselect the field in the all fields display area.
Click Confirm to finalize the configuration of the LogicalTable input widget.