3 State-of-the-Art Natural Language Processing

DOI: 10.1201/9781003348689-3

Learning Outcomes

After reading this chapter, you will be able to:

  • Understand the basic sequence-to-sequence modeling task.
  • Identify the basic building block of RNN and attention.
  • Identify the various language models such as BERT and GPT3.
  • Apply deep-learning-based sequential models for NLP applications.

3.1 Introduction

It is a huge challenge for the computers to understand information as the way we do, but advances in technology are helping in bridging the gap. Technologies like ASR, NLP, and CV are helpful in transforming in a more useful way than ever before. The ability of computers to understand and interpret the human languages was envisaged by Alan Turing ...

Get Deep Learning Approach for Natural Language Processing, Speech, and Computer Vision now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.