Skip to Main Content
Deep Learning and its Applications using Python
book

Deep Learning and its Applications using Python

by Niha Kamal Basha, Surbhi Bhatia Khan, Abhishek Kumar, Arwa Mashat
October 2023
Beginner to intermediate content levelBeginner to intermediate
256 pages
5h 42m
English
Wiley-Scrivener
Content preview from Deep Learning and its Applications using Python

6RNN and LSTM

Recurrent neural network (RNN) and long short-term memory (LSTM) [1] is one of the deep learning algorithm which deals with sequence of numerical inputs enables some tasks like hand written recognition without segmentation or speech recognition. By using convolutional neural network (CNN), these tasks are difficult to handle because it is difficult to process long sequence and training is difficult because of vanishing gradient problem. So RNN and LSTM classifiers are frequently used and also along with convolution layer by the researchers to get efficient classifier. To overcome this, LSTM and GRU are designed. The working of RNN and LSTM has been shown below with examples.

6.1 Concept of RNN

In RNN, the input is processed using hidden layers. The previous layers output is pass as an input to the next layer. It [2] contains “memory” where the information related to the operations done by each node to process the input with respect to time for generating an output of hidden layers are stored. It works as other neural networks in terms of weight and bias parameters of nodes in hidden layer. The activation functions of each node are independent and are converted to dependent for all nodes. This conversion reduces the complexity while remembering the current and previous nodes operation for hidden layer and the working of simple RNN is shown in Figure 6.1.

In the above classifier time step is denoted as t, an input is denoted as X, hidden state is denoted as h. ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Python Deep Learning - Third Edition

Python Deep Learning - Third Edition

Ivan Vasilev, Valentino Zocca
Generative Deep Learning with Python

Generative Deep Learning with Python

Cuantum Technologies LLC
Data-Centric Machine Learning with Python

Data-Centric Machine Learning with Python

Jonas Christensen, Nakul Bajaj, Manmohan Gosada
Math for Deep Learning

Math for Deep Learning

Ronald T. Kneusel

Publisher Resources

ISBN: 9781394166466Purchase Link