Hands-On Machine Learning with Azure
by Thomas K Abraham, Parashar Shah, Jen Stirrup, Lauri Lehman, Anindita Basak, Ryan Murphy
Running Databricks jobs
Azure Databricks is a cloud-based machine learning service that is able to process heavy workloads with very high efficiency. Based on Apache Spark, it is designed for handling big data and high-throughput streams in real time. With ADF, it is possible to schedule Databricks jobs to run batch workloads periodically.
To complete this example, you need access to a Databricks Workspace. If you don't have an existing Databricks account, create one first in the Azure portal.
Once you have access to a Databricks Workspace, open Data Factory Visual Tools and create a Linked Service for Databricks. The Databricks linked service is of compute type. Choose the Databricks account to connect to and configure the linked services ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access