CHAPTER 10Natural Language Processing

“Some people call this artificial intelligence, but the reality is this technology will enhance us. So instead of artificial intelligence, I think we'll augment our intelligence.”

—Ginni Rometty (American business executive, former chairman, president, and CEO of IBM)

10.1 Introduction

Natural language processing (NLP) is another popularly researched subfield of artificial intelligence. It is all about developing applications and services that are able to process and understand the human language, retrieve meaningful pieces of information from it, or even generate text output/conversations. Some practical examples of NLP are text summarization, text sentiment analysis, text generation, speech recognition, translation, chatbot, and so on. NLP has been widely used in business, finance, insurance, and healthcare.

The development of NLP can be generally divided into three stages:

  • Symbolic NLP (1950s to the early 1990s): This is rule-based NLP, where the computer processes the language by applying a collection of rules.
  • Statistical NLP (1990s to 2010s): This is the process that uses large amounts of data ...

Get Artificial Intelligence Programming with Python now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.