book

Deep Learning for Natural Language Processing

by Stephan Raaijmakers

November 2022

Beginner to intermediate

296 pages

8h 27m

English

Manning Publications

Read now

Unlock full access

prefaceacknowledgmentsabout this bookWho should read this bookHow this book is organized: A road mapAbout the codeliveBook discussion forumabout the authorabout the cover illustration
1.1 A selection of machine learning methods for NLP1.1.1 The perceptron1.1.2 Support vector machines1.1.3 Memory-based learning1.2 Deep learning1.3 Vector representations of language1.3.1 Representational vectors1.3.2 Operational vectors1.4 Vector sanitization1.4.1 The hashing trick1.4.2 Vector normalizationSummary
2.1 Basic architectures of deep learning2.1.1 Deep multilayer perceptrons2.1.2 Two basic operators: Spatial and temporal2.2 Deep learning and NLP: A new paradigmSummary
3.1 Embeddings3.1.1 Embedding by direct computation: Representational embeddings3.1.2 Learning to embed: Procedural embeddings3.2 From words to vectors: Word2Vec3.3 From documents to vectors: Doc2VecSummary

4.1 The problem4.2 The data4.2.1 Authorship attribution and verification data4.3 Data representation4.3.1 Segmenting documents4.3.2 Word-level information4.3.3 Subword-level information4.4 Models for measuring similarity4.4.1 Authorship attribution4.4.2 Verifying authorshipSummary
5.1 Memory and language5.1.1 The problem: Question Answering5.2 Data and data processing5.3 Question Answering with sequential models5.3.1 RNNs for Question Answering5.3.2 LSTMs for Question Answering5.3.3 End-to-end memory networks for Question AnsweringSummary
6.1 Memory networks for sequential NLP6.2 Data and data processing6.2.1 PP-attachment data6.2.2 Dutch diminutive data6.2.3 Spanish part-of-speech data6.3 Strongly supervised memory networks: Experiments and results6.3.1 PP-attachment6.3.2 Dutch diminutives6.3.3 Spanish part-of-speech tagging6.4 Semi-supervised memory networks6.4.1 Semi-supervised memory networks: Experiments and resultsSummary
7.1 Neural attention7.2 Data7.3 Static attention: MLP7.4 Temporal attention: LSTM7.5 Experiments7.5.1 MLP7.5.2 LSTMSummary
8.1 Introduction to multitask learning8.2 Multitask learning8.3 Multitask learning for consumer reviews: Yelp and Amazon8.3.1 Data handling8.3.2 Hard parameter sharing8.3.3 Soft parameter sharing8.3.4 Mixed parameter sharing8.4 Multitask learning for Reuters topic classification8.4.1 Data handling8.4.2 Hard parameter sharing8.4.3 Soft parameter sharing8.4.4 Mixed parameter sharing8.5 Multitask learning for part-of-speech tagging and named-entity recognition8.5.1 Data handling8.5.2 Hard parameter sharing8.5.3 Soft parameter sharing8.5.4 Mixed parameter sharingSummary
9.1 BERT up close: Transformers9.2 Transformer encoders9.2.1 Positional encoding9.3 Transformer decoders9.4 BERT: Masked language modeling9.4.1 Training BERT9.4.2 Fine-tuning BERT9.4.3 Beyond BERTSummary
10.1 Introduction: Working with BERT in practice10.2 A BERT layer10.3 Training BERT on your data10.4 Fine-tuning BERT10.5 Inspecting BERT10.5.1 Homonyms in BERT10.6 Applying BERTSummary

Overview

Explore the most challenging issues of natural language processing, and learn how to solve them with cutting-edge deep learning!

Inside Deep Learning for Natural Language Processing you’ll find a wealth of NLP insights, including:

An overview of NLP and deep learning
One-hot text representations
Word embeddings
Models for textual similarity
Sequential NLP
Semantic role labeling
Deep memory-based NLP
Linguistic structure
Hyperparameters for deep NLP

Deep learning has advanced natural language processing to exciting new levels and powerful new applications! For the first time, computer systems can achieve "human" levels of summarizing, making connections, and other tasks that require comprehension and context. Deep Learning for Natural Language Processing reveals the groundbreaking techniques that make these innovations possible. Stephan Raaijmakers distills his extensive knowledge into useful best practices, real-world applications, and the inner workings of top NLP algorithms.

About the Technology
Deep learning has transformed the field of natural language processing. Neural networks recognize not just words and phrases, but also patterns. Models infer meaning from context, and determine emotional tone. Powerful deep learning-based NLP models open up a goldmine of potential uses.

About the Book
Deep Learning for Natural Language Processing teaches you how to create advanced NLP applications using Python and the Keras deep learning library. You’ll learn to use state-of the-art tools and techniques including BERT and XLNET, multitask learning, and deep memory-based NLP. Fascinating examples give you hands-on experience with a variety of real world NLP applications. Plus, the detailed code discussions show you exactly how to adapt each example to your own uses!

What's Inside

Improve question answering with sequential NLP
Boost performance with linguistic multitask learning
Accurately interpret linguistic structure
Master multiple word embedding techniques

About the Reader
For readers with intermediate Python skills and a general knowledge of NLP. No experience with deep learning is required.

About the Author
Stephan Raaijmakers is professor of Communicative AI at Leiden University and a senior scientist at The Netherlands Organization for Applied Scientific Research (TNO).

Quotes
I loved this author’s detail, his command of linguistics, and how he brought all the concepts together.
- Vamsi Sistla, Nike

Full of non-trivial, real-world examples that expose the real potential of NLP.
- Rohit Agarwal, Mobisy Technologies

Covers deep learning for NLP from the most basic concepts to the-state-of-the-art Transformers architecture.
- Giuliano Araujo Bertoti, FATEC

Perfect for novice and expert practitioners alike.
- Ritwik Dubey, Mastercard