14

Exploring Cutting-Edge LLMs with Vertex AI and PaLM 2

Maybe Chapter 7, The Generative AI Revolution with ChatGPT, made us think that OpenAI ChatGPT ended the tremendous progression of Large Language Models (LLMs) and Generative AI. Perhaps the incredible tools, such as GitHub Copilot, GPT-4, and OpenAI’s embedding models, stunned us into believing we had reached a limit.

Then, on May 23, 2023, Google released the PaLM 2 Technical Report, built on the earlier PaLM and Pathways papers. The content of these papers is mind-blowing! The architecture of PaLM improved both software and hardware performances with ingenious innovations.

We will begin the chapter by examining Pathways to understand PaLM. We will continue and look at the main features ...

Get Transformers for Natural Language Processing and Computer Vision - Third Edition now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.