Infrastructure & Ops Superstream: AI Infrastructure
by Sam Newman, Abhishek Veeramalla, Colleen Tartow, John McBride, Ronald Petty, Adrián González Sánchez, Charity Majors
Overview
Whether you’re developing chatbots or using AI to improve performance, incorporating AI into your organization is increasingly the key to your company’s success. Keeping pace with changing consumer expectations is business-critical, but developing the right infrastructure to support AI can be a challenge: AI projects require immense amounts of power and software specifically designed to run this workload. We can help.
Our industry experts bring you up to speed on the hardware and software systems needed to support AI infrastructure. Join us to explore the tools that will help you manage the large amounts of data required by AI and ML and learn how to incorporate these tools into your workflow.
What you’ll learn and how you can apply it
- Discover AI and LLM tooling for improving efficiency and productivity
- Learn the costs, challenges, and benefits of running your own AI infrastructure and apply what you learn to cost modeling, infrastructure design patterns, and the management of AI workloads at scale
- See AI tools such as K8sGPT and HolmesGPT in action and discover ways to leverage AI providers to help manage Kubernetes-based systems
- Learn how to minimize complexity and cost in the modern AI data stack while focusing on scalability and performance
- Understand the expanding role of LLMs in modern observability, and what this means for enterprises
Recommended follow-up:
- Read Designing Machine Learning Systems (book)
- Explore Modern Automated AI Agents: Building Agentic AI to Perform Complex Tasks (on-demand course)
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Watch now
Unlock full access