Partitioning and collecting
Partitioning parallelism is key for the scalability of DataStage (DS) parallel jobs. Partitioners distribute rows of a single link into smaller segments that can be processed independently in parallel. Partitioners exist before any stage that is running in parallel. If the prior stage was running sequentially, a fan-out icon is drawn on the link in the Designer canvas, as shown in Figure 6-1.
Figure 6-1 Fan-out icon ...
Get InfoSphere DataStage Parallel Framework Standard Practices now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
