Skip to Main Content
Advanced Deep Learning with Keras
book

Advanced Deep Learning with Keras

by Rowel Atienza, Neeraj Verma, Valerio Maggio
October 2018
Intermediate to advanced content levelIntermediate to advanced
368 pages
9h 20m
English
Packt Publishing
Content preview from Advanced Deep Learning with Keras

Deep residual networks (ResNet)

One key advantage of deep networks is that they have a great ability to learn different levels of representations from both inputs and feature maps. In both classification, segmentation, detection and a number of other computer vision problems, learning different levels of features generally leads to better performance.

However, you'll find that it's not easy to train deep networks as a result of the gradient vanishes (or explodes) with depth in the shallow layers during backpropagation. Figure 2.2.1 illustrates the problem of vanishing gradient. The network parameters are updated by backpropagation from the output layer to all previous layers. Since backpropagation is based on the chain rule, there is a tendency ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Hands-On Neural Networks with Keras

Hands-On Neural Networks with Keras

Niloy Purkait
Deep Learning with Keras

Deep Learning with Keras

Antonio Gulli, Sujit Pal
Keras Deep Learning Cookbook

Keras Deep Learning Cookbook

Rajdeep Dua, Sujit Pal, Manpreet Singh Ghotra

Publisher Resources

ISBN: 9781788629416Supplemental Content