Filter Component

Filter Component

Filter rows from the input to pass a subset of rows to the next component based on a set of conditions.

Properties

Property Setting Description
Name Text The descriptive name for the component.
Filter Conditions Input Column The name of the column from the input component to which the filter is applied.
Qualifier Is (default) or Not describes if matching rows in the data should be included or excluded.
Comparator Less than (default): Value in the Input Column must be less than that specified in the Value Column.
Less than or equal to: Value in the Input Column must be less than or equal to that specified in the Value Column.
Equal to: Value in the Input Column must be equal to that specified in the Value Column.
Greater than (default): Value in the Input Column must be greater than that specified in the Value Column.
Greater than or equal to: Value in the Input Column must be greater than or equal to that specified in the Value Column.
Like Case sensitive match of the value in the Input Column and the pattern in the Value Column. ILike: Case insensitive match of the value in the Input Column and the pattern in the Value Column. Similar to: Matches the value in the Input Column with a SQL standard regular expression pattern in the Value column.
See (redshift documentation for expression syntax)
Null: Checks if the value of the Input Column is the sql "null" value.
Blank: Checks if the value of the Input Column is an empty string.
Null or blank: Checks if the value of the Input Column is either an empty string or the sql "null" value.
Comparator Less than (default): Value in the Input Column must be less than that specified in the Value Column.
Less than or equal to: Value in the Input Column must be less than or equal to that specified in the Value Column.
Equal to: Value in the Input Column must be equal to that specified in the Value Column.
Greater than (default): Value in the Input Column must be greater than that specified in the Value Column.
Greater than or equal to: Value in the Input Column must be greater than or equal to that specified in the Value Column.
Like: Case sensitive match of the value in the Input Column and the pattern in the Value Column.
ILike: Case insensitive match of the value in the Input Column and the pattern in the Value Column.
Similar to: Matches the value in the Input Column with a SQL standard regular expression pattern in the Value column.
Null: Checks if the value of the Input Column is the sql "null" value.
Blank: Checks if the value of the Input Column is an empty string.
Null or blank: Checks if the value of the Input Column is either an empty string or the sql "null" value.
Value Column The value entered by the user to use for comparison. If this value is enclosed in "double quotes" as so, then it will be treated as a column in the generated SQL, which will allow for comparing columns.
Combine Conditions AND or OR When multiple Filter Conditions are present they can be separated by AND or OR. AND means all of the Filter Conditions must be true, OR means any of the Filter Conditions must be true. Hint: For more complex conditions involving grouping several AND and OR conditions together consider creating a new field using a Calculate component that specifies your complex condition and then use that new field in a simple Filter Condition.

Strategy

Generates a where clause.

Example

This job simply filters the flights data from the Table Input and writes out the filtered output.

Filter properties are set

Filter Conditions exclude blank tail numbers and include flights since the start of 2001 from Los Angeles or Oakland