While building out a Data Lakehouse, optimizing performance of big data workloads and queries is critical to the success and scalability of your production-ready environment, in addition to maintaining high SLAs for business stakeholders that are frequently accessing data in the Lakehouse. With all the robust performance enhancement capabilities of the more mature traditional SQL data warehouses, it would be extremely valuable to have the capability of speeding up Spark SQL at runtime within a Data Lakehouse. ...
14. Adaptive Query Execution
Get The Azure Data Lakehouse Toolkit: Building and Scaling Data Lakehouses on Azure with Delta Lake, Apache Spark, Databricks, Synapse Analytics, and Snowflake now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.