9 Serving models with Kubernetes and Kubeflow
This chapter covers
- Understanding different methods of deploying and serving models in the cloud
- Serving Keras and TensorFlow models with TensorFlowServing
- Deploying TensorFlow Serving to Kubernetes
- Using Kubeflow and KFServing for simplifying the deployment process
In the previous chapter, we talked about model deployment with AWS Lambda and TensorFlow Lite.
In this chapter, we discuss the “serverful” approach to model deployment: we serve the clothing classification model with TensorFlow Serving on Kubernetes. Also, we talk about Kubeflow, an extension for Kubernetes that makes model deployment easier.
We’re going to cover a lot of material in this chapter, but Kubernetes is so complex that it’s ...
Get Machine Learning Bookcamp now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
