Skip to Main Content
The Deep Learning Workshop
book

The Deep Learning Workshop

by Mirza Rahim Baig, Thomas V. Joseph, Nipun Sadvilkar, Mohan Kumar Silaparasetty, Anthony So
July 2020
Intermediate to advanced content levelIntermediate to advanced
474 pages
8h 51m
English
Packt Publishing
Content preview from The Deep Learning Workshop

6. LSTMs, GRUs, and Advanced RNNs

Overview

In this chapter, we will study and implement advanced models and variations of the plain Recurrent Neural Network (RNN) that overcome some of RNNs' practical drawbacks and are among the best performing deep learning models at the moment. We will start by understanding the drawbacks of plain RNNs and see how the novel idea of Long Short-Term Memory overcomes them. We will then see and implement a Gated Recurrent Unit based model. We will also work with bidirectional and stacked RNNs and explore attention-based models. By the end of this chapter, you will have built and assessed the performance of these models on a sentiment classification task, observing for yourself the trade-offs in choosing ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

The Deep Learning with PyTorch Workshop

The Deep Learning with PyTorch Workshop

Hyatt Saleh, Tim Hoolihan, Learnkart Technology Private Limited, Anuj Shah, Nahar Singh, Subhash Sundaravadivelu
The Applied AI and Natural Language Processing Workshop

The Applied AI and Natural Language Processing Workshop

Krishna Sankar, Jeffrey Jackovich, Ruze Richards
The Natural Language Processing Workshop

The Natural Language Processing Workshop

Rohan Chopra, Aniruddha M. Godbole, Nipun Sadvilkar, Muzaffar Bashir Shah, Sohom Ghosh, Dwight Gunning, Ankit Bhatia, Nagendra Nagaraj, John Bura, Sumit Kumar Raj, Tom Taulli, Ankit Verma
The Deep Learning with Keras Workshop

The Deep Learning with Keras Workshop

Matthew Moocarme, Mahla Abdolahnejad, Ritesh Bhagwat

Publisher Resources

ISBN: 9781839219856Supplemental Content