Skip to Main Content
Hands-On Predictive Analytics with Python
book

Hands-On Predictive Analytics with Python

by Alvaro Fuentes
December 2018
Beginner to intermediate content levelBeginner to intermediate
330 pages
8h 32m
English
Packt Publishing
Content preview from Hands-On Predictive Analytics with Python

Dropout

As you have noticed, neural networks have a huge number of trainable parameters (weights and biases). Even with small MLPs, such as the ones we are working with, we see that we have hundreds or thousands of parameters. In the network we are working with, we have more than 22,000 trainable parameters. This is one of the reasons neural networks overfit very easily, which is why we often have to use some kind of regularization technique.

One of the most popular techniques for neural network regularization is dropout, an intuitively simple approach proposed by Hinton et al. (2012). Geoffrey E. Hinton is one of the key researchers in the development of deep learning theory and techniques. The idea is simple—at each step of the training ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Python: Advanced Predictive Analytics

Python: Advanced Predictive Analytics

Ashish Kumar, Joseph Babcock
Python: Data Analytics and Visualization

Python: Data Analytics and Visualization

Phuong Vo.T.H, Martin Czygan, Ashish Kumar, Kirthi Raman
Python: End-to-end Data Analysis

Python: End-to-end Data Analysis

Phuong Vothihong, Martin Czygan, Ivan Idris, Magnus Vilhelm Persson, Luiz Felipe Martins

Publisher Resources

ISBN: 9781789138719Supplemental Content