Talend Open Studio Cookbook

Processing multiple files at once

Often, with batch processes, it is required that multiple files are processed by the same job in a single tranche. This example shows how this can be achieved by merging a group of input files into a single output.

Getting ready

Open the jo_cook_ch08_0120_multipleFiles job. You will notice that it is currently reading a single file to a temporary file, and then copying the temporary fileto a permanent output.

How to do it...

The steps for processing multiple files at once are as follows:

1. Add a tFileList component, open it, and set the directory to context.cookbookData+"/chapter8".
2. Click on the + button under the Filemask box, and add the filemask "chapter08_jo_0120_customerData_*.txt".
3. Your tFileList should look like ...