book

Practical Deep Learning at Scale with MLflow

Name: Practical Deep Learning at Scale with MLflow
Author: Yong Liu
ISBN: 9781803241333

by Yong Liu

July 2022

Intermediate to advanced

288 pages

6h 22m

English

Packt Publishing

Read now

Unlock full access

Practical Deep Learning at Scale with MLflow
ForewordContributorsAbout the authorAbout the reviewers
Preface
Who this book is forWhat this book coversTo get the most out of this bookDownload the example code filesDownload the color imagesConventions usedGet in touchShare Your Thoughts
Section 1 - Deep Learning Challenges and MLflow Prime
Chapter 1: Deep Learning Life Cycle and MLOps Challenges
Technical requirements Understanding the DL life cycle and MLOps challengesImplementing a basic DL sentiment classifierUnderstanding DL's full life cycle developmentUnderstanding MLOps challengesUnderstanding DL data challengesUnderstanding DL model challengesUnderstanding DL code challengesUnderstanding DL explainability challengesSummaryFurther reading
Chapter 2: Getting Started with MLflow for Deep Learning
Technical requirements Setting up MLflowSetting up MLflow locally using minicondaSetting up MLflow to interact with a remote MLflow serverImplementing our first DL experiment with MLflow autologgingExploring MLflow's components and usage patternsExploring experiments and runs in MLflowExploring MLflow models and their usagesExploring MLflow code tracking and its usagesSummaryFurther reading
Section 2 – Tracking a Deep Learning Pipeline at Scale
Chapter 3: Tracking Models, Parameters, and Metrics
Technical requirementsSetting up a full-fledged local MLflow tracking serverTracking model provenanceUnderstanding the open provenance tracking frameworkImplementing MLflow model trackingTracking model metrics Tracking model parametersSummaryFurther reading
Chapter 4: Tracking Code and Data Versioning
Technical requirements Tracking notebook and pipeline versioningPipeline trackingTracking locally, privately built Python librariesTracking data versioning in Delta LakeAn example of tracking data using MLflowSummaryFurther reading
Section 3 – Running Deep Learning Pipelines at Scale
Chapter 5: Running DL Pipelines in Different Environments
Technical requirementsAn overview of different execution scenarios and environmentsRunning locally with local codeRunning remote code in GitHub locallyRunning local code remotely in the cloudRunning remotely in the cloud with remote code in GitHubSummaryFurther reading

Chapter 6: Running Hyperparameter Tuning at Scale
Technical requirements Understanding automatic HPO for DL pipelinesTypes of hyperparameters and their challengesHow HPO works and which ones to chooseCreating HPO-ready DL models with Ray Tune and MLflow Setting up Ray Tune and MLflow Creating the Ray Tune trainable for the DL modelCreating the Ray Tune HPO run functionRunning the first Ray Tune HPO experiment with MLflowRunning HPO with Ray Tune using Optuna and HyperBandSummaryFurther reading
Section 4 – Deploying a Deep Learning Pipeline at Scale
Chapter 7: Multi-Step Deep Learning Inference Pipeline
Technical requirementsUnderstanding patterns of DL inference pipelinesUnderstanding the MLflow Model Python Function APIImplementing a custom MLflow Python model Implementing preprocessing and postprocessing steps in a DL inference pipelineImplementing language detection preprocessing logicImplementing caching preprocessing and postprocessing logicImplementing response composition postprocessing logicImplementing an inference pipeline as a new entry point in the main MLprojectSummaryFurther reading
Chapter 8: Deploying a DL Inference Pipeline at Scale
Technical requirements Understanding different deployment tools and host environmentsDeploying locally for batch and web service inference Batch inferenceModel as a web serviceDeploying using Ray Serve and MLflow deployment pluginsDeploying to AWS SageMaker – a complete end-to-end guideStep 1: Build a local SageMaker Docker imageStep 2: Add additional model artifacts layers onto the SageMaker Docker imageStep 3: Test local deployment with the newly built SageMaker Docker imageStep 4: Push the SageMaker Docker image to AWS Elastic Container RegistryStep 5: Deploy the inference pipeline model to create a SageMaker endpointStep 6: Query the SageMaker endpoint for online inferenceSummaryFurther reading
Section 5 – Deep Learning Model Explainability at Scale
Chapter 9: Fundamentals of Deep Learning Explainability
Technical requirementsUnderstanding the categories and audience of explainabilityAudience: who needs to knowStage: when to provide an explanation in the DL life cycleScope: which prediction needs explanationInput data format: what is the format of the input dataOutput data format: what is the format of the output explanationProblem type: what is the machine learning problem typeObjectives type: what is the motivation or goal to explainMethod type: what is the specific post-hoc explanation method usedExploring the SHAP Explainability toolboxExploring the Transformers Interpret toolboxSummaryFurther reading
Chapter 10: Implementing DL Explainability with MLflow
Technical requirementsUnderstanding current MLflow explainability integrationImplementing a SHAP explanation using the MLflow artifact logging APIImplementing a SHAP explainer using the MLflow pyfunc APICreating and logging an MLflow pyfunc explainerDeploying an MLflow pyfunc explainer for an EaaSUsing an MLflow pyfunc explainer for batch explanationSummaryFurther reading
Why subscribe?
Other Books You May EnjoyPackt is searching for authors like youShare Your Thoughts

Content preview from Practical Deep Learning at Scale with MLflow

Chapter 7: Multi-Step Deep Learning Inference Pipeline

Now that we have successfully run HPO (Hyperparameter Optimization) and produced a well-tuned DL model that meets the business requirements, it is time to move to the next step towards using this model for prediction. This is where the model inference pipeline comes into play, where the model is used for predicting or scoring real-world data in production, either in real time or batch mode. However, an inference pipeline usually does not just rely on a single model but needs preprocessing and postprocessing logic that is not necessarily seen during the model development stage. Examples of preprocessing steps include detecting the language locale (English or some other languages) before passing ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Publisher Resources

ISBN: 9781803241333

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

Practical Deep Learning at Scale with MLflow

by Yong Liu

Chapter 7: Multi-Step Deep Learning Inference Pipeline

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.