Chapter 9: Scaling the Data Lakehouse Architecture

In the journey so far, we have covered all the seven layers of the data lakehouse architecture. However, for large organizations that are complex and spread globally, a single data lakehouse won't suffice. They will need multiple platforms to fulfill their analytical requirements. In addition, they will need a structured process to share data elements between them. Therefore, the need arises to develop a macro-architecture pattern that ensures that the organization's overall analytical requirements are met without compromising the architectural debts.

This chapter will discuss concepts that you can use to develop those macro-architecture patterns. First, we will define the need for a macro-architecture ...

Get Data Lakehouse in Action now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.