March 2022
Intermediate to advanced
720 pages
15h 47m
English
Content preview from Artificial Intelligence Programming with Python
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
Start your free trial
CHAPTER 10Natural Language Processing
“Some people call this artificial intelligence, but the reality is this technology will enhance us. So instead of artificial intelligence, I think we'll augment our intelligence.”
—Ginni Rometty (American business executive, former chairman, president, and CEO of IBM)
10.1 Introduction
Natural language processing (NLP) is another popularly researched subfield of artificial intelligence. It is all about developing applications and services that are able to process and understand the human language, retrieve meaningful pieces of information from it, or even generate text output/conversations. Some practical examples of NLP are text summarization, text sentiment analysis, text generation, speech recognition, translation, chatbot, and so on. NLP has been widely used in business, finance, insurance, and healthcare.
The development of NLP can be generally divided into three stages:
- Symbolic NLP (1950s to the early 1990s): This is rule-based NLP, where the computer processes the language by applying a collection of rules.
- Statistical NLP (1990s to 2010s): This is the process that uses large amounts of data ...