The Definitive Guide to Azure Data Engineering: Modern ELT, DevOps, and Analytics on the Azure Cloud Platform

© The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature 2021

R. C. L'EsteveThe Definitive Guide to Azure Data Engineeringhttps://doi.org/10.1007/978-1-4842-7182-7_23

23. Machine Learning in Databricks

Ron C. L’Esteve¹  

(1)

Chicago, IL, USA

 

Organizations and developers that are seeking to leverage the power of machine learning (ML) and AI spend a significant amount of time building ML models and are seeking a method for streamlining their machine learning development lifecycle to track experiments, package code into reproducible runs, as well as build, share, and deploy ML models.

MLflow is an open source platform for managing the end-to-end machine learning lifecycle, as shown in Figure 23-1. It tackles four primary ...