O'Reilly logo

Parallel Programming with Python by Jan Palach

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Chapter 6. Utilizing Parallel Python

In the previous chapter, we learned how to use the multiprocessing and ProcessPoolExecutor modules to solve two case problems. This chapter will present named pipes and how to use Parallel Python (PP) to perform parallel tasks with processes.

In this chapter, we will cover the following topics:

  • Understanding interprocess communication
  • Discovering PP
  • Using PP to calculate the Fibonacci series on SMP architecture
  • Using PP to make a distributed Web crawler

Understanding interprocess communication

Interprocess communication (IPC) consists of mechanisms that allow the exchange of information among processes.

There are several means to implement IPC, and in general, they depend on the chosen architecture for the runtime ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required