The data filtering plug-in is used to filter data based on specific rules, such as the field size. Only data that meets the rules is retained.
Prerequisites
An input node is configured. For more information, see Data source types that support real-time synchronization.
Procedure
Go to the DataStudio page.
Log on to the DataWorks console.
In the left-side navigation pane, click Workspaces.
In the top navigation bar, select the region in which the workspace that you want to manage resides. On the Workspaces page, find the workspace and click in the Actions column.
In the Scheduled Workflow pane, move the pointer over the icon and choose .
Alternatively, right-click the required workflow, and then choose
.In the Create Node dialog box, set the Sync Method parameter to End-to-end ETL and configure the Name and Path parameters.
ImportantThe node name cannot exceed 128 characters in length and can contain letters, digits, underscores (_), and periods (.).
Click Confirm.
On the configuration tab of the real-time synchronization node, drag Data Filtering in the Conversion section to the canvas on the right. Draw a line to connect the data filtering node to the input node.
Click the data filtering node. In the configuration panel that appears, configure the parameters.
Node configuration
Rules: the rules based on which you want to filter data in a data source. Only data that meets the rules is retained. For example, in the preceding figure, a rule is configured to retain data for which the values of the "hello" field are less than the values of the "this" field.
NoteWhen you configure a rule, you can configure either the Customize parameter or the second Field parameter.
Output field
The names and types of output fields after filtering.
Click the in the top toolbar.