Skip to Content
Operationalizing the Data Lake
book

Operationalizing the Data Lake

by Holden Ackerman, Jon King
July 2019
Beginner to intermediate
171 pages
4h
English
O'Reilly Media, Inc.
Content preview from Operationalizing the Data Lake

Introduction

Overview: Big Data’s Big Journey to the Cloud

It all started with the data. There was too much of it. Too much to process in a timely manner. Too much to analyze. Too much to store cost effectively. Too much to protect. And yet the data kept coming. Something had to give.

We generate 2.5 quintillion bytes of data each day (one quintillion is one thousand quadrillion, which is one thousand trillion). A NASA mathematician puts it like this: “1 million seconds is about 11.5 days, 1 billion seconds is about 32 years, while a trillion seconds is equal to 32,000 years.” This would mean one quadrillion seconds is 32 billion years—and 2.5 quintillion would be 2,500 times that.

After you’ve tried to visualize that—you can’t, it’s not humanly possible—keep in mind that 90% of all the data in the world was created in just the past two years.

Despite these staggering numbers, organizations are beginning to harness the value of what is now called big data.

Almost half of respondents to a recent McKinsey Analytics study, Analytics Comes of Age, say big data has “fundamentally changed” their business practices. According to NewVantage Partners, big data is delivering the most value to enterprises by cutting expenses (49.2%) and creating new avenues for innovation and disruption (44.3%). Almost 7 in 10 companies (69.4%) have begun using big data to create data-driven cultures, with 27.9% reporting positive results, as illustrated in Figure I-1.

Figure I-1. The benefits of deploying ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

Data Lakes

Data Lakes

Anne Laurent, Dominique Laurent, Cédrine Madera
Data Lake for Enterprises

Data Lake for Enterprises

Vivek Mishra, Tomcy John, Pankaj Misra

Publisher Resources

ISBN: 9781492049517