Machine Learning Model Serving Patterns and Best Practices

Table of Contents

Preface

Part 1: Introduction to Model Serving

1

Introducing Model Serving

Technical requirements

What is serving?

What are models?

What is model serving?

Understanding the importance of model serving

Using existing tools to serve models

Summary

2

Introducing Model Serving Patterns

Design patterns in software engineering

Understanding the value of model serving patterns

ML serving patterns

Serving philosophy patterns

Patterns of serving approaches

Summary

Further reading

Part 2: Patterns and Best Practices of Model Serving

3

Stateless Model Serving

Technical requirements

Understanding stateful and stateless functions

Stateless functions

Stateful functions

Extracting states from stateful functions

Using stateful functions

States ...