O'Reilly logo

Talend Open Studio Cookbook by Rick Barton

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Filtering input rows

Often, rows can be filtered out of a flow because they do not fulfill the required criteria for processing. This example shows how this can be achieved within the tMap component, so as to avoid costly join logic.

Tip

Note that you should not concern yourself too much with the complexity of tMap in this recipe; rather you should concentrate on the filters. Joining is covered in later recipes in this chapter.

Getting ready

Open the job jo_cook_ch04_0050_tMapInputFilter.

How to do it...

  1. Run the job. You will see that there are many records read from orderItemFile and all are being output.
  2. Kill the job and view the output. You will see many order items being displayed, all of which are duplicates. These are the ones we will need to remove. ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required