appendix E Open source LLMs
In earlier chapters, you worked with OpenAI’s public REST API. It’s a straightforward way to build large language model (LLM) applications because you don’t need to set up a local LLM host. After signing up with OpenAI and generating an API key, you can send requests to their endpoints and access LLM capabilities. This quick setup lets you work with state-of-the-art models efficiently. The main drawback is cost—running examples such as summarization might cost a few cents or even dollars. If you’re working on projects for your company, privacy might also be a concern. Some employers block OpenAI entirely to avoid the risk of leaking sensitive or proprietary data.
This appendix introduces open source LLMs, a practical ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access