book

Practical Deep Learning at Scale with MLflow

Name: Practical Deep Learning at Scale with MLflow
Author: Yong Liu
ISBN: 9781803241333

by Yong Liu

July 2022

Intermediate to advanced

288 pages

6h 22m

English

Packt Publishing

Read now

Unlock full access

Practical Deep Learning at Scale with MLflow
ForewordContributorsAbout the authorAbout the reviewers
Preface
Who this book is forWhat this book coversTo get the most out of this bookDownload the example code filesDownload the color imagesConventions usedGet in touchShare Your Thoughts
Section 1 - Deep Learning Challenges and MLflow Prime
Chapter 1: Deep Learning Life Cycle and MLOps Challenges
Technical requirements Understanding the DL life cycle and MLOps challengesImplementing a basic DL sentiment classifierUnderstanding DL's full life cycle developmentUnderstanding MLOps challengesUnderstanding DL data challengesUnderstanding DL model challengesUnderstanding DL code challengesUnderstanding DL explainability challengesSummaryFurther reading
Chapter 2: Getting Started with MLflow for Deep Learning
Technical requirements Setting up MLflowSetting up MLflow locally using minicondaSetting up MLflow to interact with a remote MLflow serverImplementing our first DL experiment with MLflow autologgingExploring MLflow's components and usage patternsExploring experiments and runs in MLflowExploring MLflow models and their usagesExploring MLflow code tracking and its usagesSummaryFurther reading
Section 2 – Tracking a Deep Learning Pipeline at Scale
Chapter 3: Tracking Models, Parameters, and Metrics
Technical requirementsSetting up a full-fledged local MLflow tracking serverTracking model provenanceUnderstanding the open provenance tracking frameworkImplementing MLflow model trackingTracking model metrics Tracking model parametersSummaryFurther reading
Chapter 4: Tracking Code and Data Versioning
Technical requirements Tracking notebook and pipeline versioningPipeline trackingTracking locally, privately built Python librariesTracking data versioning in Delta LakeAn example of tracking data using MLflowSummaryFurther reading
Section 3 – Running Deep Learning Pipelines at Scale
Chapter 5: Running DL Pipelines in Different Environments
Technical requirementsAn overview of different execution scenarios and environmentsRunning locally with local codeRunning remote code in GitHub locallyRunning local code remotely in the cloudRunning remotely in the cloud with remote code in GitHubSummaryFurther reading

Chapter 6: Running Hyperparameter Tuning at Scale
Technical requirements Understanding automatic HPO for DL pipelinesTypes of hyperparameters and their challengesHow HPO works and which ones to chooseCreating HPO-ready DL models with Ray Tune and MLflow Setting up Ray Tune and MLflow Creating the Ray Tune trainable for the DL modelCreating the Ray Tune HPO run functionRunning the first Ray Tune HPO experiment with MLflowRunning HPO with Ray Tune using Optuna and HyperBandSummaryFurther reading
Section 4 – Deploying a Deep Learning Pipeline at Scale
Chapter 7: Multi-Step Deep Learning Inference Pipeline
Technical requirementsUnderstanding patterns of DL inference pipelinesUnderstanding the MLflow Model Python Function APIImplementing a custom MLflow Python model Implementing preprocessing and postprocessing steps in a DL inference pipelineImplementing language detection preprocessing logicImplementing caching preprocessing and postprocessing logicImplementing response composition postprocessing logicImplementing an inference pipeline as a new entry point in the main MLprojectSummaryFurther reading
Chapter 8: Deploying a DL Inference Pipeline at Scale
Technical requirements Understanding different deployment tools and host environmentsDeploying locally for batch and web service inference Batch inferenceModel as a web serviceDeploying using Ray Serve and MLflow deployment pluginsDeploying to AWS SageMaker – a complete end-to-end guideStep 1: Build a local SageMaker Docker imageStep 2: Add additional model artifacts layers onto the SageMaker Docker imageStep 3: Test local deployment with the newly built SageMaker Docker imageStep 4: Push the SageMaker Docker image to AWS Elastic Container RegistryStep 5: Deploy the inference pipeline model to create a SageMaker endpointStep 6: Query the SageMaker endpoint for online inferenceSummaryFurther reading
Section 5 – Deep Learning Model Explainability at Scale
Chapter 9: Fundamentals of Deep Learning Explainability
Technical requirementsUnderstanding the categories and audience of explainabilityAudience: who needs to knowStage: when to provide an explanation in the DL life cycleScope: which prediction needs explanationInput data format: what is the format of the input dataOutput data format: what is the format of the output explanationProblem type: what is the machine learning problem typeObjectives type: what is the motivation or goal to explainMethod type: what is the specific post-hoc explanation method usedExploring the SHAP Explainability toolboxExploring the Transformers Interpret toolboxSummaryFurther reading
Chapter 10: Implementing DL Explainability with MLflow
Technical requirementsUnderstanding current MLflow explainability integrationImplementing a SHAP explanation using the MLflow artifact logging APIImplementing a SHAP explainer using the MLflow pyfunc APICreating and logging an MLflow pyfunc explainerDeploying an MLflow pyfunc explainer for an EaaSUsing an MLflow pyfunc explainer for batch explanationSummaryFurther reading
Why subscribe?
Other Books You May EnjoyPackt is searching for authors like youShare Your Thoughts

Content preview from Practical Deep Learning at Scale with MLflow

Chapter 8: Deploying a DL Inference Pipeline at Scale

Deploying a deep learning (DL) inference pipeline for production usage is both exciting and challenging. The exciting part is that, finally, the DL model pipeline can be used for prediction with real-world production data, which will provide real value to the business scenarios. However, the challenging part is that there are different DL model serving platforms and host environments. It is not easy to choose the right framework for the right model serving scenarios, which can minimize deployment complexity but provide the best model serving experiences in a scalable and cost-effective way. This chapter will cover the topics as an overview of different deployment scenarios and host environments, ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Publisher Resources

ISBN: 9781803241333

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

Practical Deep Learning at Scale with MLflow

by Yong Liu

Chapter 8: Deploying a DL Inference Pipeline at Scale

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.