Skip to Content
Pervasive Intelligence Now
book

Pervasive Intelligence Now

by Anu Jain
October 2018
Intermediate to advanced
112 pages
2h 4m
English
Wiley
Content preview from Pervasive Intelligence Now

CHAPTER 8 The Evolution of Data Lakes as a Fundamental Part of a New Ecosystem Architecture

Pervasive intelligence requires an intelligent, reliable information architecture. The foundation of an intelligent information architecture is the enterprise data warehouse (DW)—or at a minimum, function-oriented DWs that rely on the same governance structure and data definitions. Traditional DW implementations follow a set approach: define the requirements, identify (structured) data sources, define the schema, load and format the data, then distribute the data through presentation layers.

You can use historical transaction or event data in your DW to figure out what happened and why it might have happened. Based on available data, you can form hypotheses and test them against the data in the warehouse to either confirm or refute your suspicions. It can democratize BI (business intelligence) and put the power of analysis in the hands of less-than-tech-savvy users, presenting them with a single version of the “truth,” no matter who’s asking.

CHANGES IN DATA DICTATE CHANGES IN STORAGE TECHNOLOGY

Data warehouses work well as long as the data fits what you’ve defined, but no one needs to tell you that the nature of data has changed significantly over the past decade. The volume of unstructured and streaming data has far surpassed that of traditional, structured data. That flood has given rise to a new repository: the data lake.

Data lakes store unstructured data and format it when it’s ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

The Hidden Cost of AI-Assisted Creativity

The Hidden Cost of AI-Assisted Creativity

Léonard Boussioux, Anil Doshi, Oliver Hauser, Kartik Hosanagar
How to Develop a Great Digital Strategy

How to Develop a Great Digital Strategy

Jeanne W. Ross, Cynthia M. Beath, Ina M. Sebastian
Reimagining Businesses with AI

Reimagining Businesses with AI

Sudhi Sinha, Khaled Al Huraimel

Publisher Resources

ISBN: 9781119558873Purchase Link