Chapter 3

Deep learning in natural language processing

Abstract

In recent years, there have been numerous breakthroughs by deep learning in various natural language processing (NLP) fields. This chapter will introduce common deep learning models and practical skills in NLP tasks, which also lay the foundations in machine reading comprehension models. This includes deep learning techniques for natural language understanding and generation. This chapter requires a basic understanding of deep learning, neural networks, and PyTorch, which are described in detail in Appendix B.

Keywords

Natural language understanding; natural language generation; attention mechanism; encoder; decoder

3.1 From word vector to text vector

Suppose a sentence contains n words ...

Get Machine Reading Comprehension now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.