book

Machine Learning Engineering with Python - Second Edition

by Andrew P. McMahon

August 2023

Intermediate to advanced

462 pages

11h 20m

English

Packt Publishing

Read now

Unlock full access

Who this book is forWhat this book coversTo get the most out of this bookGet in touch
Technical requirementsDefining a taxonomy of data disciplinesData scientistML engineerML operations engineerData engineerWorking as an effective teamML engineering in the real worldWhat does an ML solution look like?Why Python?High-level ML system designExample 1: Batch anomaly detection serviceExample 2: Forecasting APIExample 3: Classification pipelineSummary
Technical requirementsSetting up our toolsSetting up an AWS accountConcept to solution in four stepsComparing this to CRISP-DMDiscoverUsing user storiesPlayDevelopSelecting a software development methodologyPackage management (conda and pip)PoetryCode version controlGit strategiesModel version controlDeployKnowing your deployment optionsUnderstanding DevOps and MLOpsBuilding our first CI/CD example with GitHub ActionsContinuous model performance testingContinuous model trainingSummary
Technical requirementsDefining the model factoryLearning about learningDefining the targetCutting your lossesPreparing the dataEngineering features for machine learningEngineering categorical featuresEngineering numerical featuresDesigning your training systemTraining system design optionsTrain-runTrain-persistRetraining requiredDetecting data driftDetecting concept driftSetting the limitsDiagnosing the driftRemediating the driftOther tools for monitoringAutomating trainingHierarchies of automationOptimizing hyperparametersHyperoptOptunaAutoMLauto-sklearnAutoKerasPersisting your modelsBuilding the model factory with pipelinesScikit-learn pipelinesSpark ML pipelinesSummary
Technical requirementsWriting good PythonRecapping the basicsTips and tricksAdhering to standardsWriting good PySparkChoosing a styleObject-oriented programmingFunctional programmingPackaging your codeWhy package?Selecting use cases for packagingDesigning your packageBuilding your packageManaging your environment with MakefilesGetting all poetic with PoetryTesting, logging, securing, and error handlingTestingSecuring your solutionsAnalyzing your own code for security issuesAnalyzing dependencies for security issuesLoggingError handlingNot reinventing the wheelSummary
Technical requirementsArchitecting systemsBuilding with principlesExploring some standard ML patternsSwimming in data lakesMicroservicesEvent-based designsBatchingContainerizingHosting your own microservice on AWSPushing to ECRHosting on ECSBuilding general pipelines with AirflowAirflowAirflow on AWSRevisiting CI/CD for AirflowBuilding advanced ML pipelinesFinding your ZenMLGoing with the KubeflowSelecting your deployment strategySummary
Technical requirementsScaling with SparkSpark tips and tricksSpark on the cloudAWS EMR exampleSpinning up serverless infrastructureContainerizing at scale with KubernetesScaling with RayGetting started with Ray for MLScaling your compute for RayScaling your serving layer with RayDesigning systems at scaleSummary
Going deep with deep learningGetting started with PyTorchScaling and taking deep learning into productionFine-tuning and transfer learningLiving it large with LLMsUnderstanding LLMsConsuming LLMs via APICoding with LLMsBuilding the future with LLMOpsValidating LLMsPromptOpsSummary
Technical requirementsUnderstanding the forecasting problemDesigning our forecasting serviceSelecting the toolsTraining at scaleServing the models with FastAPIResponse and request schemasManaging models in your microservicePulling it all togetherContainerizing and deploying to KubernetesContainerizing the applicationScaling up with KubernetesDeployment strategiesSummary
Technical requirementsUnderstanding the batch processing problemDesigning an ETML solutionSelecting the toolsInterfaces and storageScaling of modelsScheduling of ETML pipelinesExecuting the buildBuilding an ETML pipeline with advanced Airflow featuresSummary

Content preview from Machine Learning Engineering with Python - Second Edition

7 Deep Learning, Generative AI, and LLMOps

The world is changing. Fast. At the time of writing in mid-2023, machine learning (ML) and artificial intelligence (AI) have entered the public consciousness in a way that even a few months ago seemed impossible. With the rollout of ChatGPT in late 2022, as well as a wave of new tools from labs and organizations across the world, hundreds of millions of people are now using ML solutions every day to create, analyze, and develop. On top of this, innovation seems to only be speeding up, with what seems like a new announcement of a record-beating model or new tool every day. ChatGPT is only one example of a solution that uses what is now known as generative artificial intelligence (generative AI or GenAI ...