April 2016
Intermediate to advanced
170 pages
3h 48m
English
Content preview from Distributed Computing with PythonBecome an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
Start your free trial
Summary
This was a long chapter! We looked at Celery as a powerful package for writing distributed applications in Python. We then looked at Python-RQ, a lightweight and simpler alternative. Both packages use a distributed task queue architecture, which is a multimachine implementation of the same system that is used to distribute work that we saw in Chapter 3, Parallelism in Python.
Pyro was then introduced as an alternative approach to both Celery and Python-RQ. Pyro has a very different philosophy that is firmly rooted in the proxy pattern and remote-procedure-call (RPC) architecture for distributed systems.
Both approaches have their merits and their strengths, and undoubtedly you will find yourselves preferring one or the other.
The next chapter ...