Deep Learning Essentials

RNN architectures

Typically, RNNs have many different architectures. In this section, we will go over some basic architectures of RNNs and discuss how they fit various, different text mining applications:

• One-to-many RNN: Figure RNN: One-to-many architecture illustrates the basic idea of a one-to-many RNN architecture. As shown in the following figure, in this architecture a single input unit of RNN is mapped to multiple hidden units as well as multiple output units. One application example of this architecture is image captioning. As described previously, in this application the input layer accepts a single image and maps it to multiple words in the caption:

RNN: One-to-many architecture

• Many-to-one RNN: Figure RNN: Many-to-one architecture, ...