CHAPTER 4

Words

Chapter 3 was about images. I had been a lawyer and members of my family will tell you that I’m not a visual person. I like numbers but I swim in words. And for words, a different form of deep learning is dominant: a Recurrent Neural Network (RNN). And RNNs also learn from examples. But, in order to “understand” a specific topic, the examples must come from (and be related to) that topic.

The bottom line of RNNs is that the training data comes from ­examples that are labeled (the word Richard Socher used), or categorized or classified.1

Initially, when I found it in 2015, I was impressed with a YouTube presentation in November of 2012, in which Rick Rashid, then the head of Microsoft Research was speaking to a Chinese audience. ...

Get AI Concepts for Business Applications now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.