12
Exploring TensorFlow Serving
In this chapter, we will start our discussion by looking at a few model-serving tools. We will cover only a few of the many available tools over the next few chapters. In this chapter, we will talk about TensorFlow Serving. TensorFlow Serving is a high-performance tool for serving machine learning models. Though it is mainly used for serving TensorFlow models, it can easily be extended to other kinds of models.
At a high level, we are going to cover the following main topics in this chapter:
- Introducing TensorFlow Serving
- Using TensorFlow Serving to serve models
Technical requirements
In this chapter, we will mostly use the same libraries that we have used in the previous chapters. You should have Postman or ...
Get Machine Learning Model Serving Patterns and Best Practices now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.