Optimizing dataflow execution – the Data_Transfer transform

The transform object Data_Transfer is a pure optimization tool helping you to push down resource-consuming operations and transformations like JOIN and GROUP BY to the database level.

Getting ready

  1. Take the dataflow from the Loading data from a flat file recipe in Chapter 4, Dataflow – Extract, Transform, and Load. This dataflow loads the Friends_*.txt file into a STAGE.FRIENDS table.
  2. Modify the Friends_30052015.txt file and remove all lines except the ones about Jane and Dave.
  3. In the dataflow, add another source table, OLTP.PERSON, and join it to a source file object in the Query transform by the first-name field. Propagate the PERSONTYPE and LASTNAME columns from the source OLTP.PERSON ...

Get SAP Data Services 4.x Cookbook now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.