3 Getting bigger and leveraging the Big 3: Amazon, Microsoft Azure, and Google
This chapter covers
- Designing a flexible and scalable six-layer data platform architecture
- Understanding how layers support both batch and streaming data
- Ensuring the right foundational components for easier management
- Implementing a modern cloud data platform in AWS, Google, or Azure
Chapter 2 covered setting up a simple data platform made up of a data lake and a data warehouse in the cloud, with simple batch pipelines to ingest data. It also laid out the pros and cons of a data lake versus a data warehouse versus a combination of the two to produce the best analysis outcomes.
In this chapter, we’ll build on the data platform architecture concepts introduced in ...
Get Designing Cloud Data Platforms now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
