book

Feature Store for Machine Learning

Name: Feature Store for Machine Learning
Author: Jayanth Kumar M J
ISBN: 9781803230061

by Jayanth Kumar M J

June 2022

Beginner to intermediate

280 pages

5h 33m

English

Packt Publishing

Read now

Unlock full access

Feature Store for Machine Learning
ContributorsAbout the authorAbout the reviewer
Preface
Who this book is forWhat this book coversTo get the most out of this bookDownload the example code filesDownload the color imagesConventions usedGet in touchShare Your Thoughts
Section 1 – Why Do We Need a Feature Store?
Chapter 1: An Overview of the Machine Learning Life Cycle
Technical requirementsThe ML life cycle in practiceProblem statement (plan and create)Data (preparation and cleaning)ModelPackage, release, and monitorAn ideal world versus the real worldReusability and sharingEverything in a notebookThe most time-consuming stages of MLFiguring out the datasetData exploration and feature engineeringModeling to production and monitoringSummary
Chapter 2: What Problems Do Feature Stores Solve?
Importance of features in productionWays to bring features to productionBatch model pipelineOnline model pipelineCommon problems with the approaches used for bringing features to productionRe-inventing the wheelFeature re-calculationFeature discoverability and sharingTraining vs Serving skew Model reproducibilityLow latencyFeature stores to the rescueStandardizing ML with a feature storeFeature store avoids reprocessing dataFeatures are discoverable and sharable with the feature store Serving features at low latency with feature storesPhilosophy behind feature storesSummaryFurther reading
Section 2 – A Feature Store in Action
Chapter 3: Feature Store Fundamentals, Terminology, and Usage
Technical requirementsIntroduction to Feast and installationFeast terminology and definitionsFeast initializationFeast usageRegister feature definitionsBrowsing the feature storeAdding an entity and FeatureViewGenerate training dataLoad features to the online storeFeast behind the scenesData flow in FeastSummaryFurther reading
Chapter 4: Adding Feature Store to ML Models
Technical requirementsCreating Feast resources in AWS Amazon S3 for storing dataAWS Redshift for an offline storeCreating an IAM user to access the resourcesFeast initialization for AWSExploring the ML life cycle with FeastProblem statement (plan and create)Data (preparation and cleaning)Model (feature engineering)SummaryReferences
Chapter 5: Model Training and Inference
PrerequisitesTechnical requirementsModel training with the feature storeDee's model training experimentsRam's model training experimentsModel packagingBatch model inference with FeastOnline model inference with FeastSyncing the latest features from the offline to the online storePackaging the online model as a REST endpoint with Feast codeHandling changes to the feature set during developmentStep 1 – Change feature definitionsStep 2 – Add/update schema in the Glue/Lake Formation consoleStep 3 – Update notebooks with the changesSummary Further reading
Chapter 6: Model to Production and Beyond
Technical requirementsSetting up Airflow for orchestrationS3 bucket for Airflow metadataAmazon MWAA environment for orchestrationProductionizing the batch model pipelineProductionizing an online model pipelineOrchestration of a feature engineering jobDeploying the model as a SageMaker endpointBeyond model productionFeature drift monitoring and model retrainingModel reproducibility and prediction issuesA headstart for the next modelChanges to feature definition after production Summary

Section 3 – Alternatives, Best Practices, and a Use Case
Chapter 7: Feast Alternatives and ML Best Practices
Technical requirementsThe available feature stores on the marketThe Tecton Feature StoreDatabricks Feature StoreGoogle's Vertex AI Feature StoreThe Hopsworks Feature StoreSageMaker Feature StoreFeature management with SageMaker Feature StoreResources to use SageMakerGenerating featuresDefining the feature groupFeature ingestionGetting records from an online storeQuerying historical data with Amazon AthenaCleaning up a SageMaker feature groupML best practicesData validation at sourceBreaking down ML pipeline and orchestrationTracking data lineage and versioningThe feature repositoryExperiment tracking, model versioning, and the model repositoryFeature and model monitoringMiscellaneousSummary
Chapter 8: Use Case – Customer Churn Prediction
Technical requirementsInfrastructure setupIntroduction to the problem and the datasetData processing and feature engineeringFeature group definitions and feature ingestionModel trainingModel predictionFeature monitoringModel monitoringSummary
Why subscribe?
Other Books You May EnjoyPackt is searching for authors like youShare Your Thoughts

Content preview from Feature Store for Machine Learning

Chapter 6: Model to Production and Beyond

In the last chapter, we discussed model training and prediction for online and batch models with Feast. For the exercise, we used the Feast infrastructure that was deployed to the AWS cloud during the exercises in Chapter 4, Adding Feature Stores to ML Models. During these exercises, we looked at how Feast decouples feature engineering from model training and model prediction. We also learned how to use offline and online stores during batch and online prediction.

In this chapter, we will reuse the feature engineering pipeline and the model built in Chapter 4, Adding Feature Stores to ML Models, and Chapter 5, Model Training and Inference, to productionize the machine learning (ML) pipeline. The goal ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Feature Engineering for Machine Learning

Publisher Resources

ISBN: 9781803230061

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

Feature Store for Machine Learning

by Jayanth Kumar M J

Chapter 6: Model to Production and Beyond

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.