Daniel Arbuckle's Mastering Python

The concurrent.futures module

The concurrent.futures module is designed for programs that can be structured with one controlling process and several worker processes, where the controlling process hands out jobs to worker processes and then collects and collates the results. The following simple code example of a CPU-bound task uses the concurrent.futures module:

That's a fairly generic model, especially, for CPU-bound programs. So, concurrent.futures is as widely applicable as it is simple to use, and the preceding code example shows that it is simple.

The basic usage is to just import it, create a ProcessPoolExecutor object, and then call ...