9 Building and running your own large language model
This chapter covers
- Why you might want to build your own large language model
- Selecting an LLM model to serve as your base for a custom configuration
- How (in very general terms) model fine-tuning works
Build (or modify) your own LLM? But didn’t OpenAI (and its investors) spend billions of dollars optimizing and training their GPT? Is it possible to generate even remotely competitive results through a do-it-yourself project using local hardware?
Incredibly, at this point in the whirlwind evolution of LLM technologies, the answer to that question is yes. Due to the existence of Meta’s open source LLaMA model, an unauthorized leak of the model’s weights (which I’ll explain in just a moment), ...
Get The Complete Obsolete Guide to Generative AI now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
