Understanding Large Language Models: Learning Their Underlying Concepts and Technologies

© The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature 2023

T. AmaratungaUnderstanding Large Language Modelshttps://doi.org/10.1007/979-8-8688-0017-7_4

4. What Makes LLMs Large?

Thimira Amaratunga¹  

(1)

Nugegoda, Sri Lanka

 

By now you should have a high-level understanding of the concepts of natural language processing and how the transformer architecture and attention mechanisms revolutionized the NLP field and how it changed the way we look at language modeling. Now we are ready to step into our main topic: large language models.

You might be wondering what makes a large language model. Is an LLM the same as a transformer? And, more importantly, why do we call them “large” language models?

Let’s find out.

What Makes ...