Skip to Content
Data Governance with Unity Catalog on Databricks
book

Data Governance with Unity Catalog on Databricks

by Kiran Sreekumar, Karthik Subbarao
September 2025
Intermediate to advanced
384 pages
11h 34m
English
O'Reilly Media, Inc.
Content preview from Data Governance with Unity Catalog on Databricks

Chapter 6. Governing AI

Technology is morally neutral until we apply it.

William Gibson

AI-powered has become the most popular adjective across organizations and products. Much of that is pure hype, certainly, but it is true that more companies are indeed trying to leverage their data and build something useful using the latest AI advancements. Just like the digital transformation, the AI transformation is real, and it is happening.

The biggest challenge, however, is to build an AI-based system that is fully governed and secure. You might have experienced this firsthand: AI projects, even simple, classic ML-based ones, can be difficult to productionize. That’s often because the typical origins of such projects trace back to the laptops of data scientists or ML/AI engineers, who are normally more focused on mathematical and statistical aspects of the project and less focused on how to deploy them. In most AI projects, security is typically an afterthought, and governance aspects are nonexistent. Moreover, with the advancements in generative AI (GenAI) offerings, notably GPT models from OpenAI, new security and governance challenges have emerged.

Some of these challenges seem comical. On January 18, 2024, a user on X (formerly Twitter) posted his conversation with an AI-powered customer service chatbot from parcel delivery company DPD. The chatbot, in addition to not being as helpful as the user expected it to be, when prompted, generated a poem on how useless it is and how terrible ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

Building Generative AI Services with FastAPI

Building Generative AI Services with FastAPI

Alireza Parandeh
Fundamentals of Data Engineering

Fundamentals of Data Engineering

Joe Reis, Matt Housley
Fundamentals of Data Engineering

Fundamentals of Data Engineering

Joe Reis, Matt Housley
Prompt Engineering for LLMs

Prompt Engineering for LLMs

John Berryman, Albert Ziegler

Publisher Resources

ISBN: 9781098179625Errata Page