Real-time data flow design
Much of the DataStage history has focused on batch-oriented applications. Many mechanisms and techniques have been devised to process huge amounts of data in the shortest amount of time, in the most efficient way, in that environment.
We are aware that there are concerns related to limiting the number of job executions, processing as much data as possible in a single job run, and optimizing the interaction with the source and target databases (by using bulk SQL techniques). All these are related to bulk data processing. ...

Get InfoSphere DataStage Parallel Framework Standard Practices now with the O’Reilly learning platform.

O’Reilly members experience live online training, plus books, videos, and digital content from nearly 200 publishers.