O'Reilly logo

Exploring Data with RapidMiner by Andrew Chisholm

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Chapter 9. Resource Constraints

Processing large amounts of data requires a lot of physical processing power and memory, to say nothing of the amount of time needed for the processing. Sometimes, it is not possible to process the data using the available resources, and in this situation, some techniques can be adopted to induce the process to complete.

This becomes particularly important when building models where the processing time can depend exponentially on the number of attributes, the number of examples, and the model itself. It is therefore important to know how long something will take by doing a measurement on a smaller sample of the data. From there an estimate can be made of what performance will be for all the data, and then steps can ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required