40 Algorithms Every Programmer Should Know

Understanding the Anatomy of a Neural Network

Let's see what a neural network consists of:

• Layers: Layers are the core building blocks of a neural network. Each layer is a data-processing module that acts as a filter. It takes one or more inputs, processes it in a certain way, and then produces one or more outputs. Each time data passes through a layer, it goes through a processing phase and shows patterns that are relevant to the business question we are trying to answer.

• Loss function: A loss function provides the feedback signal that is used in the various iterations of the learning process. The loss function provides the deviation for a single example.

• Cost function: The cost function is the loss function on a complete set of examples. ...