Deep Learning with PyTorch

The history of deep learning

Though deep learning has become popular in recent years, the theory behind deep learning has been evolving since the 1950s. The following table shows some of the most popular techniques used today in DL applications and their approximate timeline:

Techniques	Year
Neural networks	1943
Backpropogation	Early 1960s
Convolution Neural Networks	1979
Recurrent neural networks	1980
Long Short-Term Memory	1997

Deep learning has been given several names over the years. It was called cybernetics in the 1970s, connectionism in the 1980s, and now it is either known as deep learning or neural networks. We will use DL and neural networks interchangeably. Neural networks are often ...