Chapter 4. Building Agentic Systems
Chapter 4
Building Agentic Systems
Even though LLMs are powerful, there are limits to what you can accomplish with a single LLM call. For example, suppose you are using a foundational model that was trained on data until October 2024, and you ask it a question about chess. Any answer from that model will not reflect who won the World Chess Championship that commenced in November 2024.
Agentic systems provide ways to get around this, and other, limitations of LLMs. We call the software that employs GenAI to automate a single step of a multistep application an agent. We refer to the entire application as being agentic. In this chapter, we look into building agentic systems (see Figure 4-1). We discuss how to implement agents that involve multiple steps, then cover two specific types of agents, RAG agents and SQL agents, that are extremely useful in practice. RAG agents allow us to provide LLMs with fresh data that they did not have access to during training. SQL agents allow the LLM to access databases of structured, often confidential, data.
In Chapter 2, we discussed how to use GenAI as a layperson (using the chat interfaces to ChatGPT, Gemini, Meta AI, and the like) and as a software developer (using the API). Toward the end of the chapter, we discussed why a single prompt is not enough for an application, such as a recipe planner. If you are performing a complex task like planning recipes, you will have to break the problem into simpler ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access