Scalable Kubernetes Infrastructure for AI Platforms

About the Authors

Alex Corvin is a senior engineering manager responsible for crafting and executing capabilities for data scientist experimentation and model training within Red Hat OpenShift AI, Red Hat’s flagship AI/ML platform. Alex has orchestrated creation and enhancement of functionalities for distributed training and fine-tuning of AI models, encompassing extensive language models, utilizing tools such as Ray and PyTorch. Alex and his team contribute heavily to several prominent open source projects including Kubeflow Pipelines, Kueue, Kuberay, Feast, and Kubeflow Training Operator. Alex has spoken at numerous industry conferences like Ray Summit, DevConf, NVIDIA GTC, OpenShift Commons, and more.

Taneem Ibrahim is a senior engineering manager whose team is responsible for several projects in the development of an enterprise-class MLOps product, Red Hat OpenShift AI. As part of the product engineering work, Taneem and his team participate in several open source projects such as model serving (KServe, ModelMesh, vLLM), responsible AI (TrustyAI, AIX360), and model registry (KubeFlow, ML Metadata). Taneem has also worked with an extensive AI partner ecosystem for integration with OpenShift AI and IBM watsonx.ai. Taneem has spoken at many industry events like Ray Summit, Red Hat Summit, and KubeCon.

Kyle Stratis is a software engineer with over a decade of experience across the AI development lifecycle in a variety of domains, including computer vision, health technology, and ...