Skip to Content
Python数据处理
book

Python数据处理

by Jacqueline Kazil, Katharine Jarmul
July 2017
Intermediate to advanced
398 pages
11h 54m
Chinese
Posts & Telecom Press
Content preview from Python数据处理
自动化和规模化
317
如果你的脚本功能组织得很好,不需要做什么修改,直接将仓库放到
Jupyter notebook
可以
导入和使用代码的地方(设置的服务器或者
notebook
PYTHONPATH
http://stackoverflow.
com/questions/3402168/permanently-add-a-directory-to-pythonpath
)是个好主意,这样你正在
使用的模块总是可用的)。通过这种方式,你可以导入那些
main
函数到
notebook
中,在有
人点击
notebook
的“运行所有”按钮时,所有的脚本会运行并且生成报告。
14.7
 大规模自动化
如果系统需要多台机器或者服务器来处理,或者报告是关于一个分布式系统或者其他事件
驱动系统的,很可能你会需要比
Web
接口、
notebook
corn
更加健壮的工具。如果你需
要一个真正的任务管理系统并且想要使用
Python
,你很幸运。在这一节中,我们会介绍一
个健壮的任务管理工具,
Celery
http://www.celeryproject.org
),它能处理大量的任务,自
动化
worker
(你会在下一节学习
worker
相关的知识),并且提供监控解决方案。
我们还会介绍操作自动化。如果你管理着一系列的服务器或不同需求的环境,这会很有帮
助。
Ansible
http://www.ansible.com
)是一个非常棒的自动化工具,能够帮助完成各种任
务,从数据库迁移到大规模集成部署。
还有一些
Celery
的替代方案,例如
Spotify ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

数据科学中的实用统计学(第2版)

数据科学中的实用统计学(第2版)

Peter Bruce, Andrew Bruce, Peter Gedeck
Java持续交付

Java持续交付

Daniel Bryant, Abraham Marín-Pérez
解密金融数据

解密金融数据

Justin Pauley

Publisher Resources

ISBN: 9787115459190