Chapter 1. A new paradigm for Big Data

This chapter covers

  • Typical problems encountered when scaling a traditional database
  • Why NoSQL is not a panacea
  • Thinking about Big Data systems from first principles
  • Landscape of Big Data tools
  • Introducing SuperWebAnalytics.com

In the past decade the amount of data being created has skyrocketed. More than 30,000 gigabytes of data are generated every second, and the rate of data creation is only accelerating.

The data we deal with is diverse. Users create content like blog posts, tweets, social network interactions, and photos. Servers continuously log messages about what they’re doing. Scientists create detailed measurements of the world around us. The internet, the ultimate source of data, is ...

Get Big Data now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.