Skip to Main Content
Modern Scala Projects
book

Modern Scala Projects

by Ilango gurusamy
July 2018
Intermediate to advanced content levelIntermediate to advanced
334 pages
8h 20m
English
Packt Publishing
Content preview from Modern Scala Projects

Increasing Java memory

Flight on-time records, compiled over a period of time, say, month by month, become big or medium data. Processing such volumes of data on a local machine is not trivial. In most cases, a local machine with limited RAM simply won't cut it. 

As challenging as this situation can be, we want to make the best use of our local machine. That brings us to why we want to increase Java memory. For example, trying to process a typical one-time dataset file of 27 columns and 509,520 rows, is enough to cause Java to run out of memory (see the following screenshot):

GC overhead limit exceeded

Firstly, java.lang.OutOfMemory occurs ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Scala Programming Projects

Scala Programming Projects

Mikael Valot, Nicolas Jorand

Publisher Resources

ISBN: 9781788624114Supplemental Content