April 2020
Intermediate to advanced
816 pages
18h 32m
Chinese
Content preview from 精通機器學習
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
544
|
第十六章：用 RNN 與 Attention 處理自然語言
下一章將介紹如何使用自動編碼網路
，
以無監督的方式來學習深度表達
（deep
representation）、
使用生成對抗網路
（GAN）
來產生圖像
，
以及其他主題
！
習題
1. 使用 stateful RNN 與 stateless RNN 的優缺點是什麼？
2. 為什麼大家使用 Encoder–Decoder RNN 而不是一般的 sequence-to-sequence RNN 來
進行自動翻譯？
3. 如何處理長度不固定的輸入序列？如何處理長度不固定的輸出序列？
4. 什麼是集束搜尋？為何要使用它？你可以用哪種工具來實作它？
5. 什麼是專注機制？它有什麼幫助？
6. Transformer 結構最重要的階層是什麼？它的目的是什麼？
7. 什麼時候要使用抽樣式 softmax ？
8. Hochreiter 與 Schmidhuber 在探討LSTM 的論文（
https://homl.info/93
）中使用
嵌入式
Reber
語法
（
embedded
Reber
grammar
）。它們是人工的語法，可產生
「BPBTSXXVPSEPE」之類的字串。你可以參考 Jenny Orr 針對這個主題的介紹
（
https://homl.info/108
）。選擇特定的嵌入式 Reber 語法（例如 Jenny Orr 的網頁介紹
的那一個），接著訓練 RNN 來辨識一個字串是否符合語法。你必須先寫一個函式來
產生一個訓練批次，裡面有大約 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.