book

Getting Started with Natural Language Processing

Name: Getting Started with Natural Language Processing
Author: Ekaterina Kochmar
ISBN: 9781617296765

by Ekaterina Kochmar

October 2022

Beginner

456 pages

15h 10m

English

Manning Publications

Read now

Unlock full access

inside front cover
Getting Started with Natural Language Processing
Copyright
dedication
contents
front matter
prefaceacknowledgmentsabout this bookWho should read this bookHow this book is organized: A road mapAbout the codeliveBook discussion forumOther online resourcesabout the authorabout the cover illustration
1 Introduction
1.1 A brief history of NLP1.2 Typical tasks1.2.1 Information search1.2.2 Advanced information search: Asking the machine precise questions1.2.3 Conversational agents and intelligent virtual assistants1.2.4 Text prediction and language generation1.2.5 Spam filtering1.2.6 Machine translation1.2.7 Spell- and grammar checkingSummarySolution to exercise 1.1
2 Your first NLP example
2.1 Introducing NLP in practice: Spam filtering2.2 Understanding the task2.2.1 Step 1: Define the data and classes2.2.2 Step 2: Split the text into words2.2.3 Step 3: Extract and normalize the features2.2.4 Step 4: Train a classifier2.2.5 Step 5: Evaluate the classifier2.3 Implementing your own spam filter2.3.1 Step 1: Define the data and classes2.3.2 Step 2: Split the text into words2.3.3 Step 3: Extract and normalize the features2.3.4 Step 4: Train the classifier2.3.5 Step 5: Evaluate your classifier2.4 Deploying your spam filter in practiceSummarySolutions to miscellaneous exercises
3 Introduction to information search
3.1 Understanding the task3.1.1 Data and data structures3.1.2 Boolean search algorithm3.2 Processing the data further3.2.1 Preselecting the words that matter: Stopwords removal3.2.2 Matching forms of the same word: Morphological processing3.3 Information weighing3.3.1 Weighing words with term frequency3.3.2 Weighing words with inverse document frequency3.4 Practical use of the search algorithm3.4.1 Retrieval of the most similar documents3.4.2 Evaluation of the results3.4.3 Deploying search algorithm in practiceSummarySolutions to miscellaneous exercises
4 Information extraction
4.1 Use cases4.1.1 Case 14.1.2 Case 24.1.3 Case 34.2 Understanding the task4.3 Detecting word types with part-of-speech tagging4.3.1 Understanding word types4.3.2 Part-of-speech tagging with spaCy4.4 Understanding sentence structure with syntactic parsing4.4.1 Why sentence structure is important4.4.2 Dependency parsing with spaCy4.5 Building your own information extraction algorithmSummarySolutions to miscellaneous exercises

5 Author profiling as a machine-learning task
5.1 Understanding the task5.1.1 Case 1: Authorship attribution5.1.2 Case 2: User profiling5.2 Machine-learning pipeline at first glance5.2.1 Original data5.2.2 Testing generalization behavior5.2.3 Setting up the benchmark5.3 A closer look at the machine-learning pipeline5.3.1 Decision Trees classifier basics5.3.2 Evaluating which tree is better using node impurity5.3.3 Selection of the best split in Decision Trees5.3.4 Decision Trees on language dataSummarySolutions to miscellaneous exercises
6 Linguistic feature engineering for author profiling
6.1 Another close look at the machine-learning pipeline6.1.1 Evaluating the performance of your classifier6.1.2 Further evaluation measures6.2 Feature engineering for authorship attribution6.2.1 Word and sentence length statistics as features6.2.2 Counts of stopwords and proportion of stopwords as features6.2.3 Distributions of parts of speech as features6.2.4 Distribution of word suffixes as features6.2.5 Unique words as features6.3 Practical use of authorship attribution and user profilingSummary
7 Your first sentiment analyzer using sentiment lexicons
7.1 Use cases7.2 Understanding your task7.2.1 Aggregating sentiment score with the help of a lexicon7.2.2 Learning to detect sentiment in a data-driven way7.3 Setting up the pipeline: Data loading and analysis7.3.1 Data loading and preprocessing7.3.2 A closer look into the data7.4 Aggregating sentiment scores with a sentiment lexicon7.4.1 Collecting sentiment scores from a lexicon7.4.2 Applying sentiment scores to detect review polaritySummarySolutions to exercises
8 Sentiment analysis with a data-driven approach
8.1 Addressing multiple senses of a word with SentiWordNet8.2 Addressing dependence on context with machine learning8.2.1 Data preparation8.2.2 Extracting features from text8.2.3 Scikit-learn’s machine-learning pipeline8.2.4 Full-scale evaluation with cross-validation8.3 Varying the length of the sentiment-bearing features8.4 Negation handling for sentiment analysis8.5 Further practiceSummary
9 Topic analysis
9.1 Topic classification as a supervised machine-learning task9.1.1 Data9.1.2 Topic classification with Naïve Bayes9.1.3 Evaluation of the results9.2 Topic discovery as an unsupervised machine-learning task9.2.1 Unsupervised ML approaches9.2.2 Clustering for topic discovery9.2.3 Evaluation of the topic clustering algorithmSummarySolutions to miscellaneous exercises
10 Topic modeling
10.1 Topic modeling with latent Dirichlet allocation10.1.1 Exercise 10.1: Question 1 solution10.1.2 Exercise 10.1: Question 2 solution10.1.3 Estimating parameters for the LDA10.1.4 LDA as a generative model10.2 Implementation of the topic modeling algorithm10.2.1 Loading the data10.2.2 Preprocessing the data10.2.3 Applying the LDA model10.2.4 Exploring the resultsSummarySolutions to miscellaneous exercises
11 Named-entity recognition
11.1 Named entity recognition: Definitions and challenges11.1.1 Named entity types11.1.2 Challenges in named entity recognition11.2 Named-entity recognition as a sequence labeling task11.2.1 The basics: BIO scheme11.2.2 What does it mean for a task to be sequential?11.2.3 Sequential solution for NER11.3 Practical applications of NER11.3.1 Data loading and exploration11.3.2 Named entity types exploration with spaCy11.3.3 Information extraction revisited11.3.4 Named entities visualizationSummaryConclusionSolutions to miscellaneous exercises
Appendix A Installation instructions
index
inside back cover

Content preview from Getting Started with Natural Language Processing

10 Topic modeling

This chapter covers

Introducing topic modeling with latent Dirichlet allocation
Exploring gensim, an NLP toolkit for topic modeling
Implementing an unsupervised topic modeling approach using gensim
Introducing several visualization techniques for topic exploration in data

The previous chapter introduced various NLP and machine-learning techniques for topic classification and topic analysis. Here is a reminder of the scenario that you’ve worked on: suppose you work as a content manager for a large news platform. Your platform hosts texts from a wide variety of authors and mainly specializes in the following set of well-established topics: Politics, Finance, Science, Sports, and Arts. Your task is to decide, for every incoming ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Deep Learning for Natural Language Processing

Publisher Resources

ISBN: 9781617296765Publisher Support Publisher Website Errata Page

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

Getting Started with Natural Language Processing

by Ekaterina Kochmar

10 Topic modeling

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.