Though deep learning has become popular in recent years, the theory behind deep learning has been evolving since the 1950s. The following table shows some of the most popular techniques used today in DL applications and their approximate timeline:
Techniques |
Year |
Neural networks |
1943 |
Backpropogation |
Early 1960s |
Convolution Neural Networks |
1979 |
Recurrent neural networks |
1980 |
Long Short-Term Memory |
1997 |
Deep learning has been given several names over the years. It was called cybernetics in the 1970s, connectionism in the 1980s, and now it is either known as deep learning or neural networks. We will use DL and neural networks interchangeably. Neural networks are often ...