Building Generative AI Services with FastAPI

Chapter 6. Real-Time Communication with Generative Models

A Note for Early Release Readers

With Early Release ebooks, you get books in their earliest form—the author’s raw and unedited content as they write—so you can take advantage of these technologies long before the official release of these titles.

This will be the 6th chapter of the final book. The GitHub repo is available at https://github.com/Ali-Parandeh/building-generative-ai-services.

If you have comments about how we might improve the content and/or examples in this book, or if you notice missing material within this chapter, please reach out to the editor at [e-mail].

Chapter Goals

1. Identify when to implement real-time communication in AI workflows

2. Discover web communication mechanisms by comparing their features, differences and similarities

3. Learn about real-time communication mechanisms including Server Sent Events (SSE) and WebSockets (WS)

4. Achieve confidence in selecting the correct streaming technology for your use case

5. Learn to implement mocked streaming endpoints from scratch for testing and prototyping

6. Learn to implement real-time API endpoints with both SSE and WebSocket mechanisms

7. Understand how to gracefully handle exceptions and close streaming connections

8. Discover API design patterns to simplify streaming endpoints

This chapter will explore AI streaming workloads, detailing the use of real-time communication technologies like Server Sent Events (SSE) and Web Sockets. You ...