Agentic GraphRAG

Chapter 7. Self-Evolution and Evaluation

A note for Early Release readers

With Early Release ebooks, you get books in their earliest form—the author’s raw and unedited content as they write—so you can take advantage of these technologies long before the official release of these titles.

This will be the 7th chapter of the final book. The GitHub repo will be made active later on.

If you’d like to be actively involved in reviewing and commenting on this draft, please reach out to the editor at @oreilly.com.

You have carefully built what looks like the right agentic architecture. Its reasoning flows through a horizontal workflow graph. Its knowledge lives in a vertical knowledge graph rich with relationships and temporal awareness. It accesses the real world through MCP-connected tools. And yet it fails, in surprising, non-intuitive ways. Its performance degrades silently over time. It requires a team of human experts in a state of constant, reactive vigilance.

The root of this fragility: you have built a machine that can think, but not one that can learn. It can execute its craft well but can never reflect on its mistakes, identify patterns in its successes, or evolve its strategies as conditions change.

The solution is not to abandon the complexity of your graph-based systems, but to use it. The graph is the prerequisite for effective evaluation and self-evolution:

• It makes the invisible visible. The graph transforms the agent’s reasoning into a persistent, queryable artifact, ...