O'Reilly logo

SAP Data Services 4.x Cookbook by Ivan Shomnikov

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Optimizing dataflow loaders – bulk-loading methods

By default, all records inside a dataflow coming to a target table object are sent as separate INSERT commands to a target table at the database level. If millions of records pass the dataflow and transformation happens on the ETL box without push-downs, the performance of sending millions of INSERT commands over the network back to a database for insertion could be extremely slow. That is why it is possible to configure the alternative load methods on the target table object inside a dataflow. These types of loads are called bulk-load loads. Bulk-load methods are different in nature, but all of them have the main principle and achieve the same goal—they avoid the execution of millions of INSERT ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required