Optimizing dataflow loaders – bulk-loading methods

By default, all records inside a dataflow coming to a target table object are sent as separate INSERT commands to a target table at the database level. If millions of records pass the dataflow and transformation happens on the ETL box without push-downs, the performance of sending millions of INSERT commands over the network back to a database for insertion could be extremely slow. That is why it is possible to configure the alternative load methods on the target table object inside a dataflow. These types of loads are called bulk-load loads. Bulk-load methods are different in nature, but all of them have the main principle and achieve the same goal—they avoid the execution of millions of INSERT ...

Get SAP Data Services 4.x Cookbook now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.