Skip to Content
Practical Retrieval Augmented Generation (RAG)
on-demand course

Practical Retrieval Augmented Generation (RAG)

with Sinan Ozdemir
November 2024
Intermediate
4h 24m
English
Pearson
Closed Captioning available in English

Overview

4+ Hours of Video Instruction

Start building, evaluating, and iterating on retrieval augmented generation (RAG) systems today!

Overview:

Practical Retrieval Augmented Generation shows you how to improve existing large language models by giving them the ability to access additional information that was not part of their original training data.

About the Instructor:

Sinan Ozdemir is the founder and CTO of LoopGenius where he uses state-of-the-art AI to help people create and run their businesses. Sinan is a former lecturer of data science at Johns Hopkins University and the author of multiple textbooks on data science and machine learning. Additionally, he is the founder of the recently acquired Kylie.ai, an enterprise-grade conversational AI platform with RPA capabilities. Sinan holds a master’s degree in pure mathematics from Johns Hopkins University and is based in San Francisco, California.

Learn How To:

  • Develop an understanding of different types of LLMs and how they fit into RAG
  • Build a RAG application using a vector database and multiple embedders
  • Test different generators like GPT-4o, Claude, Command-R, and more
  • Build your own API for running RAG
  • Demonstrate a chat application based on your RAG work
  • Utilize advance dtechniques like GraphRAG

Who Should Take This Course:

Developers, data scientists, and engineers who are interested in improving the output of their LLMs

Course Requirements:

  • Python 3 proficiency with some experience working in interactive Python environments including Notebooks (Jupyter/Google Colab/Kaggle Kernels)
  • Comfortable using the Pandas library and Python
  • Understanding of ML/deep learning fundamentals including train/test splits, loss/cost functions, and gradient descent

Lesson Descriptions:

Lesson 1. Introduction to Retrieval Augmented Generation.

Lesson 1 presents the core components of a retrieval augmented generation system and how they work together to create a seamless user experience using real-time and dynamic data.

Lesson 2. Building the Foundations

Lesson 2 covers different LLMs and which part of the family tree they come from. Whether they’re auto-encoding models, the fast readers of the bunch, or auto-regressive models, the ones that know how to write, each one will have a place in your RAG system.

Lesson 3. Advanced Prompt Engineering Techniques

Asking a question of an LLM is easy, but getting it to solve a task reliably, consistently, and with a decent level of accuracy can be a challenge. Lesson 3 focuses on the core components of a good prompt, uncovering how a language model thinks about tasks and how we can ask it to do these tasks and iterate on our prompts quickly. By the end of the lesson, you will know how to get the most consistent and reliable results from nearly any generative AI.

Lesson 4. Developing a RAG System

This lesson has you putting together all of the components you’ve been seeing so far into a single application that we can test end-to-end to get an initial gut check for how well the chatbot works. It also reveals just how little we actually know so far about how the system will work at scale, opening up the doors for LLM evaluations in later sections. This lesson also introduces the world of open-source embedders and generators and how they stack up against their closed-source cousins.

Lesson 5. Evaluating and Testing RAG Systems

In this lesson, the notion of gut checks is left behind for actually quantifying what it means for a retriever to be accurate, precise, and able to recall relevant documents while judging generators on their ability to be safe and conversational and ignore noise. You will also see different methods for evaluating the generators of the system to keep them honest and helpful.

Lesson 6. Expanding and Applying RAG Systems

The final lesson explores the cutting edge of retrieval augmented generation by fine-tuning open-source embedders, looking at how re-ranking systems can bolster your retrieval component, and showing how knowledge graphs can augment even the simplest RAG applications with dynamic, real-time, and transparent structured data by building a GraphRAG system.

About Pearson Video Training:

Pearson publishes expert-led video tutorials covering a wide selection of technology topics designed to teach you the skills you need to succeed. These professional and personal technology videos feature world-leading author instructors published by your trusted technology brands: Addison-Wesley, Cisco Press, Pearson IT Certification, Sams, and Que Topics include IT Certification, Network Security, Cisco Technology, Programming, Web Development, Mobile Development, and more. Learn more about Pearson Video training at http://www.informit.com/video.

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Watch now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

Building AI Agents with LLMs, RAG, and Knowledge Graphs

Building AI Agents with LLMs, RAG, and Knowledge Graphs

Salvatore Raieli, Gabriele Iuculano
Prompt Engineering for Generative AI

Prompt Engineering for Generative AI

James Phoenix, Mike Taylor

Publisher Resources

ISBN: 9780135414378