Test mapping
Using a passthrough mapping can help you identify if the bottleneck is at the source side. Configure a test mapping to have only source, source qualifier, and target. Consider that you have a mapping with one source, one target, and ten transformations; the time taken to process the data through mapping is 60 seconds. This means that combining the source, target, and transformation is taking 60 seconds. Create another mapping by eliminating all the transformations and run the process and check the time. Suppose that now the time taken to complete the process is 50 seconds. As compared to the combined time of target and transformation, which is 10 seconds, 50 seconds is relatively high, which can indicate we have a source bottleneck. ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access