Flight on-time records, compiled over a period of time, say, month by month, become big or medium data. Processing such volumes of data on a local machine is not trivial. In most cases, a local machine with limited RAM simply won't cut it.
As challenging as this situation can be, we want to make the best use of our local machine. That brings us to why we want to increase Java memory. For example, trying to process a typical one-time dataset file of 27 columns and 509,520 rows, is enough to cause Java to run out of memory (see the following screenshot):
GC overhead limit exceeded
Firstly, java.lang.OutOfMemory occurs ...
