Chapter 11. Neural networks that understand language: king – man + woman == ?
In this chapter
- Natural language processing (NLP)
- Supervised NLP
- Capturing word correlation in input data
- Intro to an embedding layer
- Neural architecture
- Comparing word embeddings
- Filling in the blank
- Meaning is derived from loss
- Word analogies
“Man is a slow, sloppy, and brilliant thinker; computers are fast, accurate, and stupid.”
John Pfeiffer, in Fortune, 1961
What does it mean to understand language?
What kinds of predictions do people make about language?
Up until now, we’ve been using neural networks to model image data. But neural networks can be used to understand a much wider variety of datasets. Exploring new datasets also teaches us a lot about neural ...
Get Grokking Deep Learning now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
