Machine Learning Model Serving Patterns and Best Practices

11

Business Logic Pattern

In this chapter, we will discuss the business logic pattern of serving models. In this pattern, we add some business logic, along with the model inference code. This is essential for successfully serving models because model inference code alone can’t meet the client’s requirements. We need additional business logic, such as user authentication, data validation, and feature transformation.

At a high level, we are going to cover the following main topics in this chapter:

• Introducing the business logic pattern
• Technical approaches to business logic in model serving

Technical requirements

In this chapter, we will use the same libraries that we used in previous chapters. You should have Postman or another REST API client ...