Skip to Content
Production LLM Monitoring: Observability, Tracing & Cost Optimization
on-demand course

Production LLM Monitoring: Observability, Tracing & Cost Optimization

with Paulo Dichone
February 2026
Advanced
2h 35m
English
Packt Publishing
Closed Captioning available in English

Overview

In this 2-hour course, you will learn how to implement production-grade LLM observability, tracing, and cost optimization using Langfuse, enabling faster debugging, reliable monitoring, and tighter control over LLM API spending in real-world systems.

What I will be able to do after this course

  • Implement production-grade LLM observability using Langfuse and tracing concepts
  • Reduce LLM API costs using semantic caching, model routing, and prompt optimization
  • Debug LLM applications quickly using traces, spans, and instrumentation patterns
  • Set up cost alerts and monitoring dashboards to prevent budget escalations
  • Build production-ready patterns for token tracking, cost calculation, and PII redaction

Course Instructor(s)

Paulo Dichone is a software engineer and educator who has taught 280,000+ students across 175 countries. He is the founder of Build Apps with Paulo and delivers practical, career-focused training in software development and cloud solutions. His teaching emphasizes real-world implementation that prepares learners for production challenges.

Who is it for?

This course is ideal for ML engineers, AI engineers, backend developers, and technical leads running LLM applications in production who need visibility into performance and costs. Learners should have basic Python skills, prior experience making LLM API calls, and a working Python setup with a code editor.

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Watch now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

Executive Briefing: Data catalogs—Concepts, capabilities, and key platforms

Executive Briefing: Data catalogs—Concepts, capabilities, and key platforms

Andrew Brust
Blockchain Security

Blockchain Security

Howard Poston

Publisher Resources

ISBN: 9781807605858