Infrastructure & Ops Superstream: Infrastructure for AI
by Sam Newman, Bryan Oliver, Saiyam Pathak, Nico Vibert, Romil Bhardwaj, Murat Karslioglu, Rob Reid
Overview
Modern AI and machine learning infrastructure presents unique orchestration challenges that extend far beyond traditional workloads, especially as organizations shift to training and running inference on thousands of GPUs simultaneously. This event addresses the practical realities of managing specialized compute resources, along with the platforms and tools designed to tame their complexity. Join our panel of experts as they explore the shift from traditional computing to modern AI infrastructure, detailing why factors like data center topology and rack-to-rack latency are now more important than ever.
Sessions provide hands-on guidance for building multi-cloud AI platforms by unifying different computing environments into a single abstraction. You’ll learn how to secure GPU capacity, reduce costs, and eliminate vendor lock-in while maintaining ML engineer productivity. We’ll also cover strategies for building AI-ready data foundations, exploring cloud native storage architectures and hybrid cloud agility to meet unprecedented demands for scale, performance, and resilience at the enterprise level. This event will help DevOps and infrastructure engineers effectively support their organization's AI initiatives.
What you’ll learn and how you can apply it
- Understand the basics of specialized AI infrastructure and the challenges of massive-scale GPU orchestration, recognizing the critical importance of factors like data center topology and rack-to-rack latency
- Develop strategies for building unified, cost-effective multicloud AI platforms that secure GPU capacity and eliminate vendor lock-in
- Learn how to construct AI-ready data foundations and cloud native storage architectures to meet enterprise-level demands for scale, performance, and resilience
Recommended follow-up:
- Read AI Systems Performance Engineering (book)
- Watch Build Your Own AI Lab (on-demand course)
Please note that slides or supplemental materials are not available for download from this recording. Resources are only provided at the time of the live event.
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Watch now
Unlock full access