November 2025
Beginner
384 pages
9h 45m
English
Content preview from Data Engineering for Beginners
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
CHAPTER 6Data Warehouses, Data Lakes, and Data Lakehouses
In previous chapters, we explored the fundamentals of databases, exploring how databases are structured, managed, and optimized for business operations. Databases are the backbone of data storage and retrieval for many organizations. However, traditional database systems have some limitations. This chapter will introduce you to other database solutions designed to tackle unique challenges faced by organizations.
IN THIS CHAPTER, YOU WILL LEARN ABOUT THE FOLLOWING:
- What are data warehouses and how do they work?
- Extract, transform, and load processes
- Star and Snowflake modeling techniques
- Online Transaction Processing (OLTP) and Online Analytical Processing (OLAP) systems
- Data marts and their benefits
- Storing raw data with data lakes
- The data lakehouse architecture
- Choosing between a database, a data warehouse, and a data lake
- Exploring real-world use cases
By the end of this chapter, you will have a solid foundation for understanding these key data storage paradigms, enabling you to make informed decisions while integrating them into modern data workflows. Throughout this chapter, we’ll use Dough & Delight, a fictional bakery, as our retail store example. All data models and scenarios will reference this business to provide consistency and real-world context.
Data Warehouses
Our retail store, Dough & Delight, has a relational database with separate tables for tracking customer orders, pastries, prices, and transactions. ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.