Optimizing dataflow loaders – bulk-loading methods

By default, all records inside a dataflow coming to a target table object are sent as separate INSERT commands to a target table at the database level. If millions of records pass the dataflow and transformation happens on the ETL box without push-downs, the performance of sending millions of INSERT commands over the network back to a database for insertion could be extremely slow. That is why it is possible to configure the alternative load methods on the target table object inside a dataflow. These types of loads are called bulk-load loads. Bulk-load methods are different in nature, but all of them have the main principle and achieve the same goal—they avoid the execution of millions of INSERT ...

Get SAP Data Services 4.x Cookbook now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.