7
Online Learning Model Serving
In online model serving, we want the impact on the model of recent data to be visible as soon as the data is available. In some cases, during online training, retraining of the model may happen during the serving of each response. This is done to ensure that the model is up to date with newly arrived data. In this chapter, we will talk about the online model serving pattern. We will introduce you to online model serving, the advantages and disadvantages of online model serving, and techniques for online model serving.
In this chapter, we will cover the following topics:
- Introducing online model serving
- Use cases for online model serving
- Challenges in online model serving
- Implementing online model serving
Technical ...
Get Machine Learning Model Serving Patterns and Best Practices now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
