Skip to Main Content
Natural Language Processing in Action
book

Natural Language Processing in Action

by Cole Howard, Hobson Lane, Hannes Hapke
April 2019
Intermediate to advanced content levelIntermediate to advanced
544 pages
17h 29m
English
Manning Publications
Content preview from Natural Language Processing in Action

10 Sequence-to-sequence models and attention

This chapter covers

  • Mapping one text sequence to another with a neural network
  • Understanding sequence-to-sequence tasks and how they’re different from the others you’ve learned about
  • Using encoder-decoder model architectures for translation and chat
  • Training a model to pay attention to what is important in a sequence

You now know how to create natural language models and use them for everything from sentiment classification to generating novel text (see chapter 9).

Could a neural network translate from English to German? Or even better, would it be possible to predict disease by translating genotype to phenotype (genes to body type)?[1] And what about the chatbot we’ve been talking about since the ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Natural Language Processing with PyTorch

Natural Language Processing with PyTorch

Delip Rao, Brian McMahan

Publisher Resources

ISBN: 9781617294631Supplemental ContentPublisher SupportPublisher WebsiteSupplemental ContentOtherPurchase Link