July 2017
Intermediate to advanced
398 pages
11h 54m
Chinese
Content preview from Python数据处理
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
高级网页抓取：屏幕抓取器与爬虫
｜
257
'short_name': u'',
'text_content': u'Me with my (temporary) Fairphone 2 test phone.
# happytester #wearefairphone @ Fairphone instagram.com/p/7X-KXDQzXG/'
,
'timestamp': u'POSTED ABOUT 17 HOURS AGO'},...]
我们的数据看起来有一些混乱。
for
循环很晦涩，很难阅读和理解。同样，看起来我们可
以改进一些数据收集方式——我们的日期对象只是一个字符串，但是它更应该是一个日
期。我们还需要实验
Selenium
的能力来与页面交互，这可能会帮助我们加载更多的内容。
还需要调试看到的错误。我们找不到正确的短名称；代码看起来返回了一个空字符串。在
研究了页面之后，看起来
name div
是隐藏的。在
Selenium
中，隐藏的元素通常是不能阅
读到的，所以需要使用该元素的
innerHTML
属性，这会返回标签中的内容。我们也注意到，
时间戳数据存储在
title
属性中，并且
URL
事实上存储在
data-href
中，而不是
href
属
性中。
随着时间推移，编写首次运行就可成功抓取的代码会变得更简单。预期可能
出现的问题也变得更简单。通过研究浏览器的开发者工具，并使用
IPython
进行调试，你可以操作变量，测试可能有效的方法。
在找到所有数据的基础上，要确保正确地格式化脚本。我们想要创建函数，更好地抽象数 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.