11
Leveraging LLM Embeddings as an Alternative to Fine-Tuning
Do not overlook embeddings as an alternative to fine-tuning a large language transformer model. Fine-tuning requires a reliable dataset, the right model configuration, and hardware resources. Creating high-quality datasets takes time and resources.
Leveraging the embedding abilities of a Large Language Model (LLM) such as OpenAI’s Ada will enable you to customize your model with reduced cost and effort. Your model will be able to access updated data in real time. You will be implementing Retrieval Augmented Generation (RAG) through embedded texts. We used web pages and customized text for RAG in Chapter 7, The Generative AI Revolution with ChatGPT. This time, we will go further and ...
Get Transformers for Natural Language Processing and Computer Vision - Third Edition now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
