Bidirectional RNNs
For some tasks, it can be realistic, necessary, and beneficial for the output to depend not only on past sequence elements as modeled so far, but also on future elements. Machine translation or speech and handwriting recognition are examples where subsequent sequence elements are useful and realistically available to disambiguate competing outputs.
For a one-dimensional sequence, bidirectional RNNs combine an RNN model that moves forward with another RNN that scans the sequence in the opposite direction. As a result, the output comes to depend on both the future and the past of the sequence. Applications to these domains have been very successful.
Bidirectional RNNs can also be used with two-dimensional image data. In this ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access