Optimizing dataflow readers – lookup methods

There are different ways in which to perform the lookup of a record from another table in Data Services. The three most popular ones are: a table join with a Query transform, using the lookup_ext() function, and using the sql() function.

In this recipe, we will take a look at all these methods and discuss how they affect the performance of ETL code execution and their impact on a database used to source data from.

Getting ready

We will be using the same dataflow as in the first recipe, the one which populates the PERSON_DETAILS stage table from multiple OLTP tables.

How to do it…

We will perform a lookup for the PHONENUMBER column of a person from the OLTP table PERSONPHONE in three different ways.

Lookup ...

Get SAP Data Services 4.x Cookbook now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.