O'Reilly logo

SAP Data Services 4.x Cookbook by Ivan Shomnikov

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Optimizing dataflow execution – the Data_Transfer transform

The transform object Data_Transfer is a pure optimization tool helping you to push down resource-consuming operations and transformations like JOIN and GROUP BY to the database level.

Getting ready

  1. Take the dataflow from the Loading data from a flat file recipe in Chapter 4, Dataflow – Extract, Transform, and Load. This dataflow loads the Friends_*.txt file into a STAGE.FRIENDS table.
  2. Modify the Friends_30052015.txt file and remove all lines except the ones about Jane and Dave.
  3. In the dataflow, add another source table, OLTP.PERSON, and join it to a source file object in the Query transform by the first-name field. Propagate the PERSONTYPE and LASTNAME columns from the source OLTP.PERSON ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required