The LLM Mesh

Chapter 2. Objects for Building LLM-Powered Applications

A Note for Early Release Readers

With Early Release ebooks, you get books in their earliest form—the author’s raw and unedited content as they write—so you can take advantage of these technologies long before the official release of these titles.

This will be the 2nd chapter of the final book.

If you have comments about how we might improve the content and/or examples in this book, or if you notice missing material within this chapter, please reach out to the editor at [e-mail].

LLM Mesh is a new architecture paradigm for building LLM-powered applications in the enterprise. It enables an organization to build and maintain more LLM-powered applications, ultimately getting more value from LLMs.

An LLM Mesh will allow you to:

• Access various LLM-related services through an abstraction layer.

• Provide federated services for control and analysis.

• Provide central discovery and documentation for LLM-related objects via a catalog.

This chapter will describe the many different types of LLM-related services that are used in building LLM-powered applications, and how they can be connected with one another. These various LLM-related services are called “objects” in an LLM Mesh. The final section of this chapter will describe the importance of the catalog for the discovery and use of the objects in an LLM Mesh.

We start with an explanation of why using an LLM Mesh to build LLM-powered applications is increasingly important ...