Skip to Main Content
Machine Learning Quick Reference
book

Machine Learning Quick Reference

by Rahul Kumar
January 2019
Intermediate to advanced content levelIntermediate to advanced
294 pages
6h 43m
English
Packt Publishing
Content preview from Machine Learning Quick Reference

Vanishing gradient 

Neural networks have been a revelation in extracting complex features out of the data. Be it images or texts, they are able to find the combinations that result in better predictions. The deeper the network, the higher the chances of picking those complex features. If we keep on adding more hidden layers, the learning speed of the added hidden layers get faster.

However, when we get down to backpropagation, which is moving backwards in the network to find out gradients of the loss with respect to weights, the gradient tends to get smaller and smaller as we head towards the first layer. It that initial layers of the deep network become slower learners and later layers tend to learn faster. This is called the vanishing ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Data Mining and Machine Learning Applications

Data Mining and Machine Learning Applications

Rohit Raja, Kapil Kumar Nagwanshi, Sandeep Kumar, K. Ramya Laxmi
Advanced Machine Learning with R

Advanced Machine Learning with R

Cory Lesmeister, Dr. Sunil Kumar Chinnamgari
Natural Language Processing and Computational Linguistics

Natural Language Processing and Computational Linguistics

Brian Sacash, Bhargav Srinivasa-Desikan, Reddy Anil Kumar
TensorFlow Machine Learning Projects

TensorFlow Machine Learning Projects

Ankit Jain, Dr. Amita Kapoor

Publisher Resources

ISBN: 9781788830577Supplemental Content