© The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature 2022
R. L'EsteveThe Azure Data Lakehouse Toolkithttps://doi.org/10.1007/978-1-4842-8233-5_10

10. Live Tables

Ron L’Esteve1  
(1)
Chicago, IL, USA
 

Building performant, scalable, maintainable, reliable, and testable live Data Lakehouse ELT pipelines in Azure is a critical need for many customers. These pipelines should support custom-defined ELT scripts, task orchestration, monitoring, and more. Within Azure, Data Factory and Databricks support many of these ELT capabilities and possess robust feature sets. Databricks Delta Live Tables enable data engineers to define live data pipelines using a series of Apache Spark tasks. Additionally, with Delta Live Tables, developers ...

Get The Azure Data Lakehouse Toolkit: Building and Scaling Data Lakehouses on Azure with Delta Lake, Apache Spark, Databricks, Synapse Analytics, and Snowflake now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial