Using Spoon's built-in optimization tools
Spoon being the developer's tool box, many of the tools used to fine tune and optimize transformations and jobs can be found within the interface. Developers should strive to tune their processes to match the load that it will be processing. Performance is normally measured in a few ways: CPU, RAM, and bandwidth usage, as well as the number of records that can be processed within a given timeframe. With this recipe, we'll dive into the different tools and some of the common techniques that can be used to improve performance.
Getting ready
The transformation and job used in this recipe are available via Packt's website. The example job executes the transformation, which in turn processes some randomly generated ...
Get Pentaho Data Integration Cookbook Second Edition now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.