Generative AI on Google Cloud

Chapter 1. Generative AI Foundations

A Note for Early Release Readers

With Early Release ebooks, you get books in their earliest form—the author’s raw and unedited content as they write—so you can take advantage of these technologies long before the official release of these titles.

This will be the 1st chapter of the final book. Please note that the GitHub repo will be made active later on.

If you have comments about how we might improve the content and/or examples in this book, or if you notice missing material within this chapter, please reach out to the editor at [e-mail].

In recent years, the pursuit of artificial intelligence has witnessed a groundbreaking advancement: the emergence of large language models (LLMs). Rooted in research that emulates the human brain, LLMs have paved the way for Generative AI, a revolutionary technology capable of producing realistic and intricate text, images, and computer code, mirroring human capabilities. Businesses worldwide are exploring the potential of generative AI, recognizing its ability to revolutionize various industries. Its capacity to produce realistic and sophisticated content holds promise for transforming media, finance, law, professional services, and even public sectors like education.

This transformative technology is underpinned by the Transformer model, a groundbreaking innovation developed by Google researchers in 2017 in the seminal paper “Attention is all you need”(https://arxiv.org/abs/1706.03762). This ...