R Recipes: A Problem-Solution Approach

CHAPTER 15

Dealing with Big Data

Datasets are big and getting bigger, as has been mentioned previously in this book. People talk of the five Vs of big data, which include volume, variety, velocity, veracity (or lack thereof), and value (or lack thereof). The value gleaned from big data may be short-lived, simply because of the velocity with which the data can change. To deal with bigger data, we need faster processing for larger datasets. To accomplish this, we can use parallel processing, speed up the operations of our processing, use more efficient algorithms, or some combination of these approaches. In this chapter, you will learn how to use ...