Skip to Main Content
Natural Language Processing in Action
book

Natural Language Processing in Action

by Cole Howard, Hobson Lane, Hannes Hapke
April 2019
Intermediate to advanced content levelIntermediate to advanced
544 pages
17h 29m
English
Manning Publications
Content preview from Natural Language Processing in Action

8 Loopy (recurrent) neural networks (RNNs)

This chapter covers

  • Creating memory in a neural net
  • Building a recurrent neural net
  • Data handling for RNNs
  • Backpropagating through time (BPTT)

Chapter 7 showed how convolutional neural nets can analyze a fragment or sentence all at once, keeping track of nearby words in the sequence by passing a filter of shared weights over those words (convolving over them). Words that occurred in clusters could be detected together. If those words jostled a little bit in position, the network could be resilient to it. Most importantly, concepts that appeared near to one another could have a big impact on the network. But what if you want to look at the bigger picture and consider those relationships over a longer ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Natural Language Processing with PyTorch

Natural Language Processing with PyTorch

Delip Rao, Brian McMahan

Publisher Resources

ISBN: 9781617294631Supplemental ContentPublisher SupportPublisher WebsiteSupplemental ContentOtherPurchase Link