O'Reilly logo

Talend Open Studio Cookbook by Rick Barton

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Processing multiple files at once

Often, with batch processes, it is required that multiple files are processed by the same job in a single tranche. This example shows how this can be achieved by merging a group of input files into a single output.

Getting ready

Open the jo_cook_ch08_0120_multipleFiles job. You will notice that it is currently reading a single file to a temporary file, and then copying the temporary fileto a permanent output.

How to do it...

The steps for processing multiple files at once are as follows:

  1. Add a tFileList component, open it, and set the directory to context.cookbookData+"/chapter8".
  2. Click on the + button under the Filemask box, and add the filemask "chapter08_jo_0120_customerData_*.txt".
  3. Your tFileList should look like ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required