Building LLMs for Production

LLM Frameworks

We have introduced and discussed the core idea behind RAG throughout this book. But before we get into practical examples, we will introduce two commonly used frameworks that are often used to help build RAG projects and LLM pipelines more generally: LangChain and LlamaIndex. RAG pipelines can be built from scratch without the need for these frameworks. However, frameworks like this help you get a head start and reduce your development time and cost. They typically offer a quicker path to deploying a solution with default configurations. These libraries experiment with various settings and combinations to deliver a ready-to-use, effective solution, all without requiring significant time or effort. They are perfect for reducing ...