Skip to Content
AI On-Prem Deployment
on-demand course

AI On-Prem Deployment

with Sander van Vugt
August 2026
Intermediate
4h 50m
English
Pearson
Closed Captioning available in German, English, Spanish, French, Italian, Japanese

Overview

Master onpremises GenAI: deploy; optimize; and finetune LLMs on Linux and Kubernetes to deliver private; highperformance AI; without sending your data to the cloud.

  • Deploy private GenAI on your own infrastructure: Understand GenAI fundamentals and core components, choose the right LLM, and run models locally for control over data, privacy, performance, and cost.
  • Build and optimize on Linux: Configure GPU drivers and container GPU support, tune CPU/GPU inference, and run inference servers (llama.cpp and vLLM) on platforms with or without GPU, with an accessible client experience using OpenWebUI.
  • Production-ready workflows with Kubernetes: Add proprietary documents using RAG, prepare and run GenAI on Kubernetes (GPU workloads and non-GPU, storage, access, scaling/monitoring), and complete an end-to-end deployment that ties everything together.

Concise Overview

AI On-Prem Deployment is a hands-on video course from expert trainer Sander van Vugt that shows IT and DevOps professionals how to run generative AI on their own infrastructure, so theyre not dependent on external services beyond their own hardware. Instead of sending prompts and proprietary content to the cloud, youll learn how local deployment gives you control over data, privacy, performance, models, and predictable costs, which is especially important for regulated or critical environments, airgapped or restricted networks, and situations with limited connectivity.

The course starts with GenAI fundamentals such as core components, LLM basics, and strategies to reduce system requirements, and then moves into practical deployment on Linux covering GPU drivers, container GPU support, CPU/GPU tuning, and inference servers that run in environments without GPUs. Youll also learn how to bring private data to your LLM using approaches such as RAG, and how to run GenAI on Kubernetes with a capstone end-to-end demonstration that ties everything together, including deploying an LLM, connecting to its API, adding private data, querying from a client, and applying best practices.

Skill Level

  • Beginner
  • Intermediate

 Course Requirements

  • No course requirements

About Pearson Video Training

Pearson publishes expert-led video tutorials covering a wide selection of technology topics designed to teach you the skills you need to succeed. These professional and personal technology videos feature world-leading author instructors published by your trusted technology brands: Addison-Wesley, Cisco Press, Pearson IT Certification, Sams, and Que. Topics include: IT Certification, Network Security, Cisco Technology, Programming, Web Development, Mobile Development, and more. Learn more about Pearson Video training at http://www.informit.com/video.

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Watch now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

Generative AI on Kubernetes

Generative AI on Kubernetes

Roland Huß, Daniele Zonca
Generative AI on AWS

Generative AI on AWS

Chris Fregly, Antje Barth, Shelbee Eigenbrode

Publisher Resources

ISBN: 9780135894217