Hands-On Machine Learning for Algorithmic Trading

LeNet5 – the first modern CNN (1998)

Yann LeCun, now the Director of AI Research at Facebook, was a leading pioneer in CNN development. In 1998, after several iterations starting in the 1980s, LeNet5 became the first modern CNN used in real-world applications, which introduced several architectural elements still relevant today.

LeNet5 was published in a very instructive paper, Gradient-Based Learning Applied to Document Recognition (co-authored by Yoshua Bengio and others: http://yann.lecun.com/exdb/publis/pdf/lecun-01a.pdf), that laid out many of the central concepts. Most importantly, it promoted the insight that convolutions with learnable filters are effective at extracting related features at multiple locations with few parameters. ...