Learning Pentaho Data Integration 8 CE - Third Edition

Reading several files at the same time

In the main exercise, you used an Input step to read a single file. But suppose you have several files, all with the same structure. Reading those files at the same time is not much different from what you did.

For this quick tutorial, we will take as a source several files with the same structure as sales_data.csv, but separated by region. This is the list of files which you will find in the SAMPLEFILES folder:

sales_data_APAC.csvsales_data_EMEA.csvsales_data_Japan.csv

You have two options here. The first way for reading several files at the same time would be to provide the detailed list of filenames:

1. Open the Transformation that reads the sales_data.csv file.
2. Fill the grid with every filename, as ...