Advanced RAG Course
Author: Guy Ernest
Course Overview
This course is designed for AI engineers, MLOps engineers, Solutions and Enterprise Architects, and Software Developers who are building (or want to build) AI applications in an enterprise environment. Students will learn the main concepts of successful AI applications using LLMs, which are essential to achieving high levels of performance and accuracy.
Module 1: Introduction to Retrieval-Augmented Generation (RAG)
Lesson 0.0: Course Introductions
-
Video: Mastering LLM Introduction
Lesson 1.0: Understanding the Basics of RAG
-
Video: 1.0 Simple RAG Introduction
-
Topics covered:
-
Definition and overview of RAG
-
Importance of RAG in enhancing language model capabilities
-
Using vector databases
-
Naive embedding methods
-
Basic applications and examples of RAG
Lesson 1.1: Building Simple RAG Example
-
Video: Simple RAG notebook
-
Hands-on lab: 01_simple_rag notebook
Lesson 1.2: Issues with Simple RAG
-
Video: Issues with simple RAG - Recall Precision Tradeoff
Module 2: Text Encoding using Embedding Vectors
Lesson 2.0: Embedding Introduction
-
Video: Embedding Introduction
Lesson 2.1: Hands-on Lab: Embedding - Tokenization
-
Video: Tokenization
-
Notebook: 02_embedding_notebook
Lesson 2.2: Hands-on Lab: Embedding - Vocabulary
Lesson 2.3: Hands-on Lab: Embedding - Sentence Embedding
-
Video: Sentence Embedding
Lesson 2.4: Hands-on Lab: Embedding - Content Embedding
Lesson 2.5: Embedding Notebook Summary
Module 3: Document Chunking and Enrichment Strategies
Lesson 3.0: Chunking Introduction
-
Video: Chunking Introduction
Lesson 3.1: Hands-on Lab: Semantic Chunking
-
Video: Chunking Notebook
-
Notebook: 03_semantic_chunking
Lesson 4.0: Chunking Overview
Lesson 4.1: Hands-on Lab: Contextual Retrieval
-
Video: Contextual Retrieval
-
Notebook: 04_contextual_retrieval
Lesson 4.2: Query Document Alignment
-
Video: Query Document Alignment
Lesson 4.3: Hands-on Lab: Reverse Hyde
-
Video: Reverse Hyde Notebook
-
Notebook: 05_reverse_hyde
Module 4: Improving Document Retrieval
Lesson 5.0: Hybrid Search Introduction
-
Video: Hybrid Search Introduction
Lesson 5.1: Hands-on Lab: Hybrid Search
-
Video: Hybrid Search
-
Notebook: 06_hybrid_search
Lesson 5.2: Hands-on Lab: Reranking
-
Video: Reranking
-
Notebook: 07_reranking
Lesson 6.0: Multimodal Retrieval Introduction
-
Video: Multimodal Retrieval
Lesson 6.1: Hands-on Lab: Multimodal PDF Retrieval
-
Video: Multimodal Retrieval
-
Notebook: 08_muldimodal_pdf