Skip to Content
LLMOps
book

LLMOps

by Abi Aryan
July 2025
Intermediate to advanced
284 pages
8h 21m
English
O'Reilly Media, Inc.
Book available

Overview

Here's the thing about large language models: they don't play by the old rules. Traditional MLOps completely falls apart when you're dealing with GenAI. The model hallucinates, security assumptions crumble, monitoring breaks, and agents can't operate. Suddenly you're in uncharted territory. That's exactly why LLMOps has emerged as its own discipline.

LLMOps: Managing Large Language Models in Production is your guide to actually running these systems when real users and real money are on the line. This book isn't about building cool demos. It's about keeping LLM systems running smoothly in the real world.

  • Navigate the new roles and processes that LLM operations require
  • Monitor LLM performance when traditional metrics don't tell the whole story
  • Set up evaluations, governance, and security audits that actually matter for GenAI
  • Wrangle the operational mess of agents, RAG systems, and evolving prompts
  • Scale infrastructure without burning through your compute budget
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

FastAPI

FastAPI

Bill Lubanovic
AI at the Edge

AI at the Edge

Daniel Situnayake, Jenny Plunkett
Practical MLOps

Practical MLOps

Noah Gift, Alfredo Deza
Generative AI Design Patterns

Generative AI Design Patterns

Valliappa Lakshmanan, Hannes Hapke

Publisher Resources

ISBN: 9781098154196Errata Page