Chapter 3

Hitting Complexity with Neural Networks


check Upgrading the perceptron to the interconnection paradigm

check Structuring neural architectures made of nodes and connections

check Getting a glimpse of the backpropagation algorithm

check Understanding what deep learning is and what it can achieve

“Computers will overtake humans … within the next 100 years. When that happens, we need to make sure the computers have goals that align with ours.”


As you journey in the world of machine learning, you often see metaphors from the natural world to explain the details of algorithms. This chapter presents a family of learning algorithms that directly derives inspiration from how the brain works. They are neural networks, the core algorithms of the connectionists’ tribe.

Starting with the idea of reverse-engineering how a brain processes signals, the connectionists base neural networks on biological analogies and their components, using brain terms such as neurons and axons as names. However, you’ll discover that neural networks resemble nothing more than a sophisticated kind ...

Get Coding All-in-One For Dummies now with the O’Reilly learning platform.

O’Reilly members experience live online training, plus books, videos, and digital content from nearly 200 publishers.