book

Building LLM Powered Applications

by Valentina Alto

May 2024

Intermediate to advanced

342 pages

8h 45m

English

Packt Publishing

Read now

Unlock full access

Who this book is forWhat this book coversTo get the most out of this bookGet in touchMaking the Most Out of This Book – Get to Know Your Free BenefitsUnlock Your Book’s Exclusive BenefitsHow to unlock these benefits in three easy stepsNeed help?
What are large foundation models and LLMs?AI paradigm shift – an introduction to foundation modelsUnder the hood of an LLMMost popular LLM transformers-based architecturesEarly experimentsIntroducing the transformer architectureTraining and evaluating LLMsTraining an LLMModel evaluationBase models versus customized modelsHow to customize your modelSummaryReferences
How LLMs are changing software developmentThe copilot systemIntroducing AI orchestrators to embed LLMs into applicationsThe main components of AI orchestratorsLangChainHaystackSemantic KernelHow to choose a frameworkSummaryReferences
The most promising LLMs in the marketProprietary modelsGPT-4Gemini 1.5Claude 2Open-source modelsLLaMA-2Falcon LLMMistralBeyond language modelsA decision framework to pick the right LLMConsiderationsCase studySummaryReferences
Technical requirementsWhat is prompt engineering?Principles of prompt engineeringClear instructionsSplit complex tasks into subtasksAsk for justificationGenerate many outputs, then use the model to pick the best oneUse delimitersAdvanced techniquesFew-shot approachChain of thoughtReActSummaryReferences
Technical requirementsA brief note about LangChainGetting started with LangChainModels and promptsData connectionsMemoryChainsAgentsWorking with LLMs via the Hugging Face HubCreate a Hugging Face user access tokenStoring your secrets in an .env fileStart using open-source LLMsSummaryReferences
Technical requirementsGetting started with conversational applicationsCreating a plain vanilla botAdding memoryAdding non-parametric knowledgeAdding external toolsDeveloping the front-end with StreamlitSummaryReferences
Technical requirementsIntroduction to recommendation systemsExisting recommendation systemsK-nearest neighborsMatrix factorizationNeural networksHow LLMs are changing recommendation systemsImplementing an LLM-powered recommendation systemData preprocessingBuilding a QA recommendation chatbot in a cold-start scenarioBuilding a content-based systemDeveloping the front-end with StreamlitSummaryReferences
Technical requirementsWhat is structured data?Getting started with relational databasesIntroduction to relational databasesOverview of the Chinook databaseHow to work with relational databases in PythonImplementing the DBCopilot with LangChainLangChain agents and SQL AgentPrompt engineeringAdding further toolsDeveloping the front-end with StreamlitSummaryReferences
Technical requirementsChoosing the right LLM for codeCode understanding and generationFalcon LLMCodeLlamaStarCoderAct as an algorithmLeveraging Code InterpreterSummaryReferences

Technical requirementsWhy multimodality?Building a multimodal agent with LangChainOption 1: Using an out-of-the-box toolkit for Azure AI ServicesGetting Started with AzureCognitiveServicesToolkitSetting up the toolkitLeveraging a single toolLeveraging multiple toolsBuilding an end-to-end application for invoice analysisOption 2: Combining single tools into one agentYouTube tools and WhisperDALL·E and text generationPutting it all togetherOption 3: Hard-coded approach with a sequential chainComparing the three optionsDeveloping the front-end with StreamlitSummaryReferences
Technical requirementsWhat is fine-tuning?When is fine-tuning necessary?Getting started with fine-tuningObtaining the datasetTokenizing the dataFine-tuning the modelUsing evaluation metricsTraining and savingSummaryReferences
What is Responsible AI and why do we need it?Responsible AI architectureModel levelMetaprompt levelUser interface levelRegulations surrounding Responsible AISummaryReferences
The latest trends in language models and generative AIGPT-4V(ision)DALL-E 3AutoGenSmall language modelsCompanies embracing generative AICoca-ColaNotionMalbekMicrosoftSummaryReferences

Content preview from Building LLM Powered Applications

13 Emerging Trends and Innovations

Dear reader, if you have made it up to this point – congratulations! You managed to complete this journey into LLMs and how to implement modern applications with them. Starting from the fundamentals of what’s under the hood of an LLM, we covered many scenarios of LLM-powered applications, from conversational chatbots, to database copilots, to multimodal agents. We experimented with different models, both proprietary and open-source, and we also managed to fine-tune our own LLM. Last but not least, we covered the key topic of Responsible AI and how to embed ethical considerations within our LLM-powered applications.

In this final chapter, we are going to explore the latest advancements and future trends in the ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Start your free trial

Publisher Resources

ISBN: 9781835462317Supplemental Content

Building LLM Powered Applications

by Valentina Alto

13

Emerging Trends and Innovations

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

You might also like

Designing Data-Intensive Applications

AI Engineering

AI Engineering

AI Engineering

Publisher Resources

13

Emerging Trends and Innovations

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,and much more.

You might also like

Designing Data-Intensive Applications

AI Engineering

AI Engineering

AI Engineering

Publisher Resources

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.