Skip to Main Content
The Language of Deception
book

The Language of Deception

by Justin Hutchens, Stuart McClure
December 2023
Intermediate to advanced content levelIntermediate to advanced
400 pages
8h 58m
English
Wiley
Content preview from The Language of Deception

Chapter 9Multimodal Manipulation

So far, I have discussed the significant risks associated with the latest generation of LLMs. Unfortunately, language is only the tip of the iceberg. The underlying technology, specifically the transformer architecture, has proven to have broad usefulness that extends far beyond natural language processing (NLP). The transformer architecture has come to be used as a multimodal architecture. The term multimodal implies that models built on top of the architecture can be used to process multiple types of data concurrently—in the case of transformers, combining text data with other types of data such as images, audio, and other more obscure data structures. The ability to integrate other modes of data into this architecture, which itself is so well optimized for scaling, has numerous significant implications of its own. As these new modalities become increasingly integrated into our language models, the risk of abuse only continues to grow. To understand the additional risks related to multimodal transformer models, we should first examine a brief history of transformers.

Converging on Transformers

The transformer model was introduced in a research paper entitled “Attention is all you need” as a feed-forward neural network architecture to optimize the use of deep learning for the purposes of NLP. As discussed throughout the entirety of this book, transformers have worked exceptionally well for language. But in the years that followed that publication, ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

The Language of Deception

The Language of Deception

Justin Hutchens

Publisher Resources

ISBN: 9781394222544Purchase Link