August 2022
Intermediate to advanced
441 pages
11h 26m
Chinese
Content preview from Python文本分析
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
71
第 3 章
网页抓取与数据提取
在访问某个网站的时候，你常常会发现非常有趣的内容。如果只有几页的话，你可
以读完所有的内容。但是，如果量非常大的话，靠自己的力量就不可能全部读完了。
如果想使用本书介绍的强大的文本分析技术的话，你必须先获取内容。大多数网站
都没有“下载所有内容”的按钮，所以我们必须找到一种聪明的办法来下载（“抓取”）
页面。
通常，我们关心的只是各个网页的内容，对于导航等则不太感兴趣。等到将数据下
载本地后，我们就可以使用强大的数据提取技术，将页面分解成标题、内容以及其
他元信息（发布日期、作者等）。
3.1
本章内容概要
在本章中，我们将向你展示如何获取网站的
HTML
数据，并使用功能强大的工具从
这些
HTML
文件中提取内容。我们将通过路透社新闻存档这个特定的数据源为例进
行说明。
第一步，我们先来下载一个
HTML
文件，然后通过不同的方法提取每个
HTML
文
件中的数据。
通常，我们想要的不仅仅是单个页面。因此，我们来构建一个解决方案。我们将下
载并分析某个新闻存档页面（其中包含所有文章的链接）。通过这一步，我们可以
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.