The Filtering and Mapping component uses the expressions of filter conditions to filter data. This component allows you to modify the names of the columns that you want to filter.

You can configure the component by using one of the following methods:
  • Use the Machine Learning Platform for AI console
    Parameter Description
    Mapping Rules The columns that you want to filter. By default, all columns are selected. You can also modify the names of the columns.
    Filter Conditions Similar to the WHERE clause in SQL statements, the WHERE clause you specified is used to filter data. Example: age>40.
    Note Only the following operators are supported:
    • =
    • !=
    • >
    • <
    • >=
    • <=
    • like
    • rlike
  • Use commands
    PAI -name Filter
        -project algo_public \
        -DoutTableName="test_9" \
        -DinputPartitions="pt=20150501" \
        -DinputTableName="bank_data_partition" \
        -Dfilter="age>=40";
    Parameter Required Description
    outputTableName Yes The name of the output table.
    inputPartitions No The partitions that are selected from the input table for training. If you want to select the entire table, set the parameter to None.
    inputTableName Yes The name of the input table.
    filter No Similar to the WHERE clause in SQL statements, the WHERE clause you specified is used to filter data. Example: age>40.
    Note Only the following operators are supported:
    • =
    • !=
    • >
    • <
    • >=
    • <=
    • like
    • rlike