2 Storage

This chapter covers

  • Storing data in a data platform
  • Using Azure Data Explorer for ingestion and analytics
  • Using Azure Data Lake Storage for big data storage
  • Applying data ingestion patterns

Data storage is the core piece of a data platform around which everything else is built. The focus of this chapter is storage solutions and trade-offs. We’ll also introduce two Azure services that we will use and discuss how these integrate. Figure 2.1 recaps the high-level view from chapter 1, highlighting the component discussed in this chapter.

Figure 2.1 Storage is the core piece of a data platform around which everything else is built. Data ...

Get Data Engineering on Azure now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.