AI System Design
Published by O'Reilly Media, Inc.
From problem to production
What you’ll learn and how you can apply it
- Apply a repeatable framework for designing production-grade AI systems
- You want a repeatable framework for making architecture, data, and tech-stack decisions for your AI products
- You've shipped an AI prototype but aren't sure how to take it to production with confidence
- Design AI systems tailored to your specific business and technical requirements
- Select the right architecture, retrieval strategy, and technology stack for your use case
- Define evaluation metrics and guardrails to measure the performance of your AI systems
Course description
Writing code is no longer the hard part; AI can do that. Now the most valuable skill an engineer can have is knowing what to build. Most AI systems never make it to production because of bad decisions made earlier in the process. The pressure to ship fast, the hype around AI, and the lack of a structured approach all push engineers toward building before they’ve really thought through what they’re building and why.
In this course, Apoorva Joshi presents you with a structured framework for making the decisions that get AI systems to production. You’ll discover how to identify the business problem, define success metrics, select the right architecture, define guardrails and evaluation metrics, and know what to optimize for when you ship. During the session, you’ll apply this framework to a real-world problem and leave with a concrete system design and a repeatable process for taking AI applications from problem to production.
This live event is for you because...
- You’re a software engineer building or planning to build AI-powered applications.
Prerequisites
Recommended follow-up:
- Read AI Engineering (book)
- Read Building Application with AI Agents (book)
- Read Evals for AI Engineers (book)
Schedule
The time frames are only estimates and may vary according to how the class is progressing.
Introduction (5 minutes)
- Presentation: The shift towards product-first development
The AI system design framework (4 minutes)
- Presentation: The four phases from problem to production
Gathering product requirements (25 minutes)
- Presentation: Gathering product requirements
- Hands-on exercise: Write down product requirements for a healthcare AI use case
System design (50 minutes)
- Presentation: Data and retrieval; system architecture and tech stack; UX and feedback
- Hands-on exercises: Identify data sources and retrieval techniques for the healthcare AI system; identify the system architecture, tech stack, UX, and feedback mechanisms for the healthcare AI system
- Break
Evaluation and monitoring (25 minutes)
- Presentation: Defining guardrails and evaluation metrics
- Hands-on exercise: Determine the guardrails and evaluation metrics for the healthcare AI system
Production readiness (10 minutes)
- Presentation: Optimizing for accuracy, cost, latency, and reliability
- Q&A
Your Instructor
Apoorva Joshi
Apoorva Joshi is a data scientist turned developer advocate, with over six years of experience applying machine learning to problems in cybersecurity. As an AI developer advocate at MongoDB, she now helps developers succeed at building AI applications through written content and hands-on workshops.
Skills covered
- System Design
- AI Principles
- Site Reliability Engineering (SRE)
- Systems Engineering