Machine Learning Systems

Chapter 8. Responding

This chapter covers

• Using models to respond to user requests
• Managing containerized services
• Designing for failure

Now we come to the final component of a machine learning system—the part responsible for using models to respond to user requests and act on the real world (see figure 8.1). In the last chapter, we began using models in a more real-world way than just playing with them on a laptop. The approach we took involved building predictive microservices that wrapped models and then putting those microservices into containers. This chapter continues that approach by using containerized predictive services in systems that are exposed to real requests for predictions.

Figure 8.1. Phases of machine learning

Using ...