Chapter 12
Managing Big Data
IN THIS CHAPTER
Becoming familiar with Moore’s Law and its implications
Understanding big data and its 4 Vs
Discovering how to deal with infinite streaming data
Leveraging sampling, hashing, and sketches for stream data
Big data is more than a buzzword used by vendors to propose innovative ways to store data and analyze it. Big data is also not a fad. Instead, it’s a reality and a driving force of our times. You may have heard it mentioned in many specialized scientific and business publications and even wondered what big data really means (no, it isn’t about placing information on billboards in large letters). From a technical point of view, big data refers to large and complex amounts of computer data, so large (as the name implies) and intricate that the data you can’t deal with it by making more storage available on your computers or by making new computers more powerful and faster in their computations. The first part of this chapter discusses the implications of big data and what it means with regard to algorithms.
You need to know more about data ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access