book

Kubeflow for Machine Learning

by Trevor Grant, Holden Karau, Boris Lublinsky, Richard Liu, Ilan Filonenko

October 2020

Intermediate to advanced

261 pages

6h 19m

English

O'Reilly Media, Inc.

Book available

Read now

Unlock full access

Our Assumption About YouYour Responsibility as a PractitionerConventions Used in This BookCode ExamplesUsing Code ExamplesO’Reilly Online LearningHow to Contact the AuthorsHow to Contact UsAcknowledgmentsGrievances
Model Development Life CycleWhere Does Kubeflow Fit In?Why Containerize?Why Kubernetes?Kubeflow’s Design and Core ComponentsData Exploration with NotebooksData/Feature PreparationTrainingHyperparameter TuningModel ValidationInference/PredictionPipelinesComponent OverviewAlternatives to KubeflowClipper (RiseLabs)MLflow (Databricks)OthersIntroducing Our Case StudiesModified National Institute of Standards and TechnologyMailing List DataProduct RecommenderCT ScansConclusion
Getting Set Up with KubeflowInstalling Kubeflow and Its DependenciesSetting Up Local KubernetesSetting Up Your Kubeflow Development EnvironmentCreating Our First Kubeflow ProjectTraining and Deploying a ModelTraining and Monitoring ProgressTest QueryGoing Beyond a Local DeploymentConclusion
Getting Around the Central DashboardNotebooks (JupyterHub)Training OperatorsKubeflow PipelinesHyperparameter TuningModel InferenceMetadataComponent SummarySupport ComponentsMinIOIstioKnativeApache SparkKubeflow Multiuser IsolationConclusion
Getting Started with PipelinesExploring the Prepackaged Sample PipelinesBuilding a Simple Pipeline in PythonStoring Data Between StepsIntroduction to Kubeflow Pipelines ComponentsArgo: the Foundation of PipelinesWhat Kubeflow Pipelines Adds to Argo WorkflowBuilding a Pipeline Using Existing ImagesKubeflow Pipeline ComponentsAdvanced Topics in PipelinesConditional Execution of Pipeline StagesRunning Pipelines on ScheduleConclusion
Deciding on the Correct ToolingLocal Data and Feature PreparationFetching the DataData Cleaning: Filtering Out the JunkFormatting the DataFeature PreparationCustom ContainersDistributed ToolingTensorFlow ExtendedDistributed Data Using Apache SparkDistributed Feature Preparation Using Apache SparkPutting It Together in a PipelineUsing an Entire Notebook as a Data Preparation Pipeline StageConclusion
Kubeflow ML MetadataProgrammatic QueryKubeflow Metadata UIUsing MLflow’s Metadata Tools with KubeflowCreating and Deploying an MLflow Tracking ServerLogging Data on RunsUsing the MLflow UIConclusion
Building a Recommender with TensorFlowGetting StartedStarting a New Notebook SessionTensorFlow TrainingDeploying a TensorFlow Training JobDistributed TrainingUsing GPUsUsing Other Frameworks for Distributed TrainingTraining a Model Using Scikit-LearnStarting a New Notebook SessionData PreparationScikit-Learn TrainingExplaining the ModelExporting ModelIntegration into PipelinesConclusion
Model ServingModel Serving RequirementsModel MonitoringModel Accuracy, Drift, and ExplainabilityModel Monitoring RequirementsModel UpdatingModel Updating RequirementsSummary of Inference RequirementsModel Inference in KubeflowTensorFlow ServingReviewSeldon CoreDesigning a Seldon Inference GraphTesting Your ModelServing RequestsMonitoring Your ModelsReviewKFServingServerless and the Service PlaneData PlaneExample WalkthroughPeeling Back the Underlying InfrastructureReviewConclusion

The Denoising CT Scans ExampleData Prep with PythonDS-SVD with Apache SparkVisualizationThe CT Scan Denoising PipelineSharing the PipelineConclusion
AutoML: An OverviewHyperparameter Tuning with Kubeflow KatibKatib ConceptsInstalling KatibRunning Your First Katib ExperimentPrepping Your Training CodeConfiguring an ExperimentRunning the ExperimentKatib User InterfaceTuning Distributed Training JobsNeural Architecture SearchAdvantages of Katib over Other FrameworksConclusion
Google CloudTPU-Accelerated InstancesDataflow for TFX
Building Streaming Applications Leveraging Model ServingStream Processing Engines and LibrariesIntroducing CloudflowBuilding Batch Applications Leveraging Model Serving

Content preview from Kubeflow for Machine Learning

Chapter 7. Training a Machine Learning Model

In Chapter 5, we learned how to prepare and clean up our data, which is the first step in the machine learning pipeline. Now let’s take a deep dive into how to use our data to train a machine learning model.

Training is often considered the “bulk” of the work in machine learning. Our goal is to create a function (the “model”) that can accurately predict results that it hasn’t seen before. Intuitively, model training is very much like how humans learn a new skill—we observe, practice, correct our mistakes, and gradually improve. In machine learning, we start with an initial model that might not be very good at its job. We then put the model through a series of training steps, where training data is fed to the model. At each training step, we compare the prediction results produced by our model with the true results, and see how well our model performed. We then tinker with the parameters to this model (for example, by changing how much weight is given to each feature) to attempt to improve the model’s accuracy. A good model is one that makes accurate predictions without overfitting to a specific set of inputs.

In this chapter, we are going to learn how to train machine learning models using two different libraries—TensorFlow and Scikit-learn. TensorFlow has native, first-class support in Kubeflow, while Scikit-learn does not. But as we will see in this chapter, both libraries can be easily integrated with Kubeflow. We’ll demonstrate ...