Optimizing dataflow readers – lookup methods

There are different ways in which to perform the lookup of a record from another table in Data Services. The three most popular ones are: a table join with a Query transform, using the lookup_ext() function, and using the sql() function.

In this recipe, we will take a look at all these methods and discuss how they affect the performance of ETL code execution and their impact on a database used to source data from.

Getting ready

We will be using the same dataflow as in the first recipe, the one which populates the PERSON_DETAILS stage table from multiple OLTP tables.

How to do it…

We will perform a lookup for the PHONENUMBER column of a person from the OLTP table PERSONPHONE in three different ways.

Lookup ...

Get SAP Data Services 4.x Cookbook now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.