Practical Natural Language Processing
by Sowmya Vajjala, Bodhisattwa Majumder, Anuj Gupta, Harshit Surana
Chapter 1. NLP: A Primer
A language is not just words. It’s a culture, a tradition, a unification of a community, a whole history that creates what a community is. It’s all embodied in a language.
Noam Chomsky
Imagine a hypothetical person, John Doe. He’s the CTO of a fast-growing technology startup. On a busy day, John wakes up and has this conversation with his digital assistant:
John: “How is the weather today?”
Digital assistant: “It is 37 degrees centigrade outside with no rain today.”
John: “What does my schedule look like?”
Digital assistant: “You have a strategy meeting at 4 p.m. and an all-hands at 5:30 p.m. Based on today’s traffic situation, it is recommended you leave for the office by 8:15 a.m.”
While he’s getting dressed, John probes the assistant on his fashion choices:
John: “What should I wear today?”
Digital assistant: “White seems like a good choice.”
You might have used smart assistants such as Amazon Alexa, Google Home, or Apple Siri to do similar things. We talk to these assistants not in a programming language, but in our natural language—the language we all communicate in. This natural language has been the primary medium of communication between humans since time immemorial. But computers can only process data in binary, i.e., 0s and 1s. While we can represent language data in binary, how do we make machines understand the language? This is where natural language processing (NLP) comes in. It is an area of computer science that deals with methods to ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access