Deep Learning with Python: Learn Best Practices of Deep Learning Models with PyTorch

© Nikhil Ketkar, Jojo Moolayil 2021

N. Ketkar, J. MoolayilDeep Learning with Pythonhttps://doi.org/10.1007/978-1-4842-5364-9_3

3. Feed-Forward Neural Networks

Nikhil Ketkar¹   and Jojo Moolayil²

(1)

Bangalore, Karnataka, India

(2)

Vancouver, BC, Canada

 

Feed-forward neural networks were the earliest implementations within deep learning. These networks are called feed-forward because the information within them moves only in one direction (forward)—that is, from the input nodes (units) towards the output units. In this chapter, we will cover some key concepts around feed-forward neural networks that serve as a foundation for various topics within deep learning. We will start by looking at the structure of a neural network, followed by how they are trained ...