September 2013
Intermediate to advanced
264 pages
5h
Chinese
Content preview from Bad Data 技術手冊
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
154
|
第十二章：當資料庫攻擊時：何時要堅持使用檔案的守則
政治性質的部落格圈非常活躍。跟成熟的社會媒體相比，儘管部落格的品質以及深度較
低，但熱情的人們似乎很樂意讓自己處於政治辯論的火焰之中。
建構我的工具組
我需要學習文字分析以及自然語言處理（NLP）的技巧，但我的指導教授跟我很有信心
的認為，一定可以從這個大型語料庫中推論出什麼。最簡單的方法就是去抓紐西蘭政治
類部落格的內容，辨識出關於開放資料的討論串，辨識出在該主題作出評論的人，然後
抓出這些評論。我也打算要花些時間來將評論者分類。也許我們可以看到一些對開放資
料感興趣的評論者的特別事情。
該論文本身是成功的，但在部落格上的這些工作都沒有被包含在內。當專案進行到一半
時，我深信抓取網頁將會是我的最大挑戰。它一開始看起來很簡單。部落格擁有一些文
章，而我想要這些文章。可悲的是，部落格除了文章之外還有許多其他東西。它擁有評
論、日期、位置、標籤以及連結。評論者往往也會有跟這些相關的計數值。而評論本身
也擁有評分。
在資料抽取程序中的複雜性，真的讓網路爬蟲的開發進度變得緩慢。我有許多遺失值以
及例外的問題。在抽取過程中的錯誤可能會造成整個爬蟲的損毀。沒有快取的損毀爬
蟲，則需要從最一開始重新抓取內容。我能夠清除錯誤並且讓我的抽取程序更有效率，
所以抓取內容變得越來越沒有問題。
事實證明，
真正
的問題是儲存空間，因為我需要遠比工具能夠處理的查詢還要更特別的
查詢。
路障：我的資料儲存
我選擇使用的資料庫是 CouchDB。以下是我作此決定的幾個理由：
• 我並沒有電腦科學的背景 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.