The LLM Mesh

Chapter 1. Using LLMs in the Enterprise

A Note for Early Release Readers

With Early Release ebooks, you get books in their earliest form—the author’s raw and unedited content as they write—so you can take advantage of these technologies long before the official release of these titles.

This will be the 1st chapter of the final book.

If you have comments about how we might improve the content and/or examples in this book, or if you notice missing material within this chapter, please reach out to the editor at [e-mail].

“May you live in times of rapid technological progress.” This is the blessing and the curse of our current moment. Recent advances in AI and a growing interest in technology, thanks to the release of wildly popular consumer products, have led to a frenzy of interest in, and use of, AI, and Large Language Models (LLMs) in particular, in the enterprise.

However, AI and LLMs remain nascent in the enterprise, meaning that best practices for their use are being defined. At the same time, the core technologies — the models themselves, technologies to host and serve the models, etc. — are evolving rapidly.

Table 1-1 provides a brief timeline of the release of various models and technologies that could be relevant for enterprise use. The diversity and speed of release create both opportunities and challenges when you are looking to use these technologies in production use cases.

Table 1-1. A (Non-Exhaustive) Timeline of Enterprise-Relevant Model and Product ...