Skip to Content
Structured for Intelligence
book

Structured for Intelligence

by Tom Taulli, Tom Grabowski, Sai Maddali
December 2025
Intermediate to advanced
46 pages
1h 2m
English
O'Reilly Media, Inc.
Content preview from Structured for Intelligence

Chapter 2. The Structured Context Interface for Governance and Trust

In just a few years, prompt engineering has turned into a cottage industry. There are many books on the topic, as well as seemingly endless blogs and LinkedIn posts. Then there are the workshops, YouTube videos, and courses.

The major LLM providers, such as OpenAI, Anthropic, and Google, have published their own guides. For example, Google has written a 68-page handbook by Lee Boonstra. It covers topics like how to change the creativity of responses and craft prompts for multistep reasoning.

Yet all this points to something interesting: prompt engineering is a clear sign of the limitations of chat-based LLMs. They are brittle, as they rely on probabilistic transformer models. After all, with an application like ChatGPT, Claude, or Gemini, you will likely get a different response with the same prompt. Even minor changes in a word or punctuation can result in wildly different outputs.

True, this unpredictability is fine for summarizing long PDF documents or evaluating customer reviews. But it is far from ideal when it comes to working with complex enterprise workflows, which need to be reliable and consistent.

As for agentic AI, it certainly holds much promise to address the issues of chat-based interfaces. This should mean that prompt engineering will fade in importance. But successfully deploying agentic AI systems will be challenging. According to a report from Gartner, more than 40% of these projects will be ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

The Human Factor in AI-Based Decision-Making

The Human Factor in AI-Based Decision-Making

Philip Meissner, Christoph Keding
Perfecting Your Thinking Skills

Perfecting Your Thinking Skills

MIT Sloan Management Review

Publisher Resources

ISBN: 9798341653009