O'Reilly logo

Multicore and GPU Programming by Gerassimos Barlas

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Chapter 5

Distributed memory programming

Abstract

What makes distributed memory programming relevant to multicore platforms, is scalability: stand-alone, shared memory, multicore systems just do not have to potential to scale beyond the performance envelope of their memory bus. Attaining even higher performance is thus, relegated to collections of systems that communicate over a network.

The Message Passing Interface (MPI) covered in this chapter, can be considered as the “glue” that makes such distributed memory systems operate as cohesive platforms. MPI facilitates both point-to-point communication, and efficient collective communication operations that improve performance and reduce program clutter. In its latest incarnation, MPI-3 also ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required