O'Reilly logo

Hands-On Natural Language Processing with Python by Rajalingappaa Shanmugamani, Rajesh Arumugam

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Encoder-decoder architecture

As the name encoder-decoder suggests, this architecture consists of an encoder and a decoder component. This is illustrated in the following diagram. The function of the encoder is to take an input text sequence and convert it into a dense vector representation, also known as a thought vector or context vector. The thought vector, in essence, is an internal representation that captures the context and meaning of the whole input text. The decoder takes the dense vector representation of the original, complete text and generates the output summary, one word at a time:

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required