Chapter 3: Understanding the Data Lake Storage Layer

One of the components in our modern data warehouse Architecture that spans over all the processing steps, and is available to all the participating services, is our Data Lake Storage Layer.

It will serve as our landing zone, the transient storage while we're transforming and cleaning our data, and a source for queries for the analytical components. Users will establish their sandboxes, processes will store their logs here, and Data Scientists will use it as their main playground, together with their tools.

In this chapter, you will learn how to set up Azure Data Lake Gen2 Storage, and also find suggestions about how to organize it so that you can flexibly react to any challenge. You will learn ...

Get Cloud Scale Analytics with Azure Data Services now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.