July 2025
Intermediate to advanced
18h 18m
English
Closed Captioning available in German, English, Spanish, French, Italian, Japanese
Overview
The best way to understand LLMs is to build one yourself. This course gives you that power.
In this engaging liveVideo, veteran AI researcher Sebastian Raschka leads you step by step through the inner workings of a large language model. You'll see and hear Sebastian talk you through each step of the LLM project you build in his bestselling book Build a Large Language Model (From Scratch).
In this liveVideo, you'll explore how to:
This liveVideo is the perfect orientation to LLMs for software engineers ready to lead AI initiatives or data scientists and ML researchers who want build or adapt their own LLMs.
This unique course also includes six essential prerequisite videos created by AI expert Abhinav Kimothi, author of A Simple Guide to Retrieval Augmented Generation. Abhinav delivers an insightful review of everything from the Python features you need to work on LLMs to advanced PyTorch operations, ensuring you can succeed regardless of your starting point.
prerequisites
We've added six essential prerequisite videos covering everything from Python fundamentals to advanced PyTorch operations, ensuring you can succeed regardless of your starting point.
about the authors
Sebastian Raschka, PhD, is an LLM Research Engineer with over a decade of experience in artificial intelligence. His work spans industry and academia, including implementing LLM solutions as a senior engineer at Lightning AI and teaching as a statistics professor at the University of Wisconsin–Madison. He is the author of the bestselling books Machine Learning with PyTorch and Scikit-Learn, and Machine Learning Q and AI.
Abhinav Kimothi is a seasoned data and AI professional. He has spent over 15 years in consulting and leadership roles in data science, machine learning and AI, and currently works as a Director of Data Science at Sigmoid.
In this engaging liveVideo, veteran AI researcher Sebastian Raschka leads you step by step through the inner workings of a large language model. You'll see and hear Sebastian talk you through each step of the LLM project you build in his bestselling book Build a Large Language Model (From Scratch).
In this liveVideo, you'll explore how to:
- Plan and code all the parts of an LLM
- Prepare a dataset suitable for LLM training
- Fine-tune LLMs for text classification and with your own data
- Use human feedback to ensure your LLM follows instructions
- Load pretrained weights into an LLM
This liveVideo is the perfect orientation to LLMs for software engineers ready to lead AI initiatives or data scientists and ML researchers who want build or adapt their own LLMs.
This unique course also includes six essential prerequisite videos created by AI expert Abhinav Kimothi, author of A Simple Guide to Retrieval Augmented Generation. Abhinav delivers an insightful review of everything from the Python features you need to work on LLMs to advanced PyTorch operations, ensuring you can succeed regardless of your starting point.
prerequisites
We've added six essential prerequisite videos covering everything from Python fundamentals to advanced PyTorch operations, ensuring you can succeed regardless of your starting point.
- Python Environment Setup - Get your development environment perfect from day one
- Python Fundamentals - Master loops, conditionals, variables, functions, methods, and classes
- Vector Mathematics - Build intuitive understanding of the math behind AI
- PyTorch Essentials - From basic tensors to advanced operations
- Neural Network Foundations - Dot products, matrix multiplication, and activation functions
- Deep Learning Building Blocks - Linear layers, loss functions, backpropagation, and gradient calculation
about the authors
Sebastian Raschka, PhD, is an LLM Research Engineer with over a decade of experience in artificial intelligence. His work spans industry and academia, including implementing LLM solutions as a senior engineer at Lightning AI and teaching as a statistics professor at the University of Wisconsin–Madison. He is the author of the bestselling books Machine Learning with PyTorch and Scikit-Learn, and Machine Learning Q and AI.
Abhinav Kimothi is a seasoned data and AI professional. He has spent over 15 years in consulting and leadership roles in data science, machine learning and AI, and currently works as a Director of Data Science at Sigmoid.
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Watch now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.