Chapter 8: Data Aggregation Stage – The Gold Layer
Well done on making it this far! Your journey is fast approaching its final stage. I am happy to report that our skilled driver (data engineer) has successfully maneuvered the vehicle (data pipeline) through to its final leg of the journey. In the final leg of the journey, all the previously collected data that has been curated will be put to good use for descriptive, diagnostic, predictive, and prescriptive analysis.
In the previous chapter, we performed a deep dive into data curation. Using a variety of data curation examples, we successfully built the curation silver layer of the Electroniz lakehouse. In this chapter, we will continue building the next and final layer of the Electroniz lakehouse: ...
Get Data Engineering with Apache Spark, Delta Lake, and Lakehouse now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
