Apache Spark Deep Learning Cookbook

There's more...

LSTMs were a big leap forward when compared to what could be accomplished with feedforward networks and Recurrent Neural Networks. One might wonder what the next big step in the near future is, or even what that step might be. A lot researchers do believe "attention" is the next big step when it comes to the field of artificial intelligence. With the amount of data growing vastly with each day it becomes impossible to process every single bit of that data. This is where attention could be a potential game-changer, causing the networks to give their attention only to data or areas which are of high priority or interest and disregard useless information. For example, if an RNN is being used to create an image captioning engine, ...