Deep Reinforcement Learning with Python: RLHF for Chatbots and Large Language Models

© The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature 2024

N. SanghiDeep Reinforcement Learning with Pythonhttps://doi.org/10.1007/979-8-8688-0273-7_11

11. Proximal Policy Optimization (PPO) and RLHF

Nimish Sanghi¹  

(1)

Bangalore, India

 

This is an exciting chapter. It starts from the foundations and builds toward one of the most exciting uses of RL. Have you have used ChatGPT or another Large Language Model (LLM) and found it amazing how these models seem to follow your prompts and complete a task that you describe in English? Apart from the machinery of generative AI and transformers-driven architecture, RL also plays a very important role. Proximal Policy Optimization (PPO) using human annotated (or machine annotated) ...