9
Shattering the Black Box with Interpretable Tools
Million-to-trillion-parameter transformer models, such as ChatGPT and GPT-4 , appear to be impenetrable black boxes that nobody can interpret. As a result, many developers and users have sometimes been discouraged when dealing with these mind-blowing models. However, recent research has begun to solve the problem with cutting-edge tools to interpret the inner workings of a transformer model.
Shattering the transformer black boxes will build trust between those who design them and those who implement and use them.
It is beyond the scope of this book to describe all the interpretable AI methods and algorithms. Many systems exist, but our goal is not to explore them all. Instead, this chapter ...
Get Transformers for Natural Language Processing and Computer Vision - Third Edition now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
