SAP Data Services 4.x Cookbook

Optimizing dataflow execution – the Data_Transfer transform

The transform object Data_Transfer is a pure optimization tool helping you to push down resource-consuming operations and transformations like JOIN and GROUP BY to the database level.

Getting ready

1. Take the dataflow from the Loading data from a flat file recipe in Chapter 4, Dataflow – Extract, Transform, and Load. This dataflow loads the Friends_*.txt file into a STAGE.FRIENDS table.
2. Modify the Friends_30052015.txt file and remove all lines except the ones about Jane and Dave.
3. In the dataflow, add another source table, OLTP.PERSON, and join it to a source file object in the Query transform by the first-name field. Propagate the PERSONTYPE and LASTNAME columns from the source OLTP.PERSON ...