CHAPTER 4Generative AI's Exponential Growth

The previous chapters touched on the sudden emergence of generative AI, a phenomenon that seemed to materialize out of thin air. However, the reality is far from it. Much like a gourmet dish simmering away in the back of a bustling kitchen, generative AI was quietly brewing, its flavors intensifying, until it was finally ready to be served. The first taste came in the summer of 2022 with OpenAI's DALL-E, followed closely by the unveiling of ChatGPT toward the end of the same year.

The explosion of generative AI was the result of a carefully curated recipe. The ingredients? A blend of technological advancements and convergences that, when combined, propelled AI to unprecedented heights. This chapter peels back the layers and explores the underlying factors that played a pivotal role in the rise of generative AI.

First on our list is the exponential increase in computing power, often encapsulated by Moore's law. This principle, which posits that the number of transistors on a microchip doubles approximately every two years, has been a driving force behind our ability to perform increasingly complex computations at breakneck speeds. This, in turn, has been instrumental in training large-scale AI models, the backbone of generative AI.

Next, we have the advent of cloud computing. This technology has revolutionized the way we access and utilize high-powered computing resources, making them more affordable and readily available. The democratization ...

Get Generative AI now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.