Hands-On Software Engineering with Python

Summary 

In this chapter, we have covered all of the basic permutations (serial and parallel, local and remote/distributed) of multiprocessing in Python, as it would apply to custom HPC operations. The basics needed for integrating a process written in Python to be executed by a large-scale cluster computing system such as Hadoop are quite basic—simple executable scripts—and the integration prospects with those system are as varied as the systems themselves.