Building Applications with Large Language Models: Techniques, Implementation, and Applications

© The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature 2024

B. SinghBuilding Applications with Large Language Modelshttps://doi.org/10.1007/979-8-8688-0569-1_8

8. Run in Production

Bhawna Singh¹  

(1)

Dublin, Ireland

 

Thus, writing a clever piece of code at works is one thing; designing something that can support a long-lasting business is quite another. Commercial software design and production is, or should be, a rigorous, capital-intensive activity.

—Charles H. Ferguson

Introduction

The quote above will resonate with you if you’ve ever deployed any kind of software or machine learning model into the production. To me, production is like thoroughly cleaning the house; using the best ingredients, best china, and best recipes; ...