Building Live Voice Agents

Chapter 7. Multi-Agent Systems: Collaboration and Orchestration

A Note for Early Release Readers

With Early Release ebooks, you get books in their earliest form—the author’s raw and unedited content as they write—so you can take advantage of these technologies long before the official release of these titles.

This will be Chapter 7 of the final book. Please note that the GitHub repo will be made active later on.

If you’d like to be actively involved in reviewing and commenting on this draft, please reach out to the editor at [e-mail].

A single-agent system is powerful, but as you scale, you’ll run into the same challenges that software developers face with large, monolithic applications. As you pile on more and more tools for different, unrelated tasks (like math, history, and grammar), the agent’s core reasoning can get confused, its performance can drop, and testing and maintaining it can become a nightmare.

Just as the software world moved from monoliths to microservices, we can apply this same powerful idea to our AI systems. Instead of one “monolithic” agent, we can build a multi-agent system—a team of smaller, specialized agents that collaborate to solve a complex problem. When this microservice-style approach is architected optimally, it makes your overall system more robust, easier to scale, and simpler to maintain. Table 7-1 summarizes the architectural trade-offs between these two approaches, highlighting why the monolithic design degrades under scale. ...