Learning Pentaho Data Integration 8 CE - Third Edition

Filtering unwanted rows with a Filter rows step

You just build a list of words coming from a sample file. As you would see, there are blank rows, and also a lot of rows with pronouns, articles, and other very small words. If you want to keep only the words relevant to the subject of the text file, you will want to discard all this. For doing this, we will use the Filter rows step - a step dedicated to filtering rows based on conditions and comparisons. In its simplest version, for every row, the step checks a given condition and let's pass only those rows for which the condition is true. The other rows are lost. The following are the instructions for implementing this solution:

1. Expand the Flow category of steps, and drag the Filter rows ...