Skip to Main Content
Multicore and GPU Programming
book

Multicore and GPU Programming

by Gerassimos Barlas
December 2014
Intermediate to advanced content levelIntermediate to advanced
698 pages
19h 8m
English
Morgan Kaufmann
Content preview from Multicore and GPU Programming
Chapter 5

Distributed memory programming

Abstract

What makes distributed memory programming relevant to multicore platforms, is scalability: stand-alone, shared memory, multicore systems just do not have to potential to scale beyond the performance envelope of their memory bus. Attaining even higher performance is thus, relegated to collections of systems that communicate over a network.

The Message Passing Interface (MPI) covered in this chapter, can be considered as the “glue” that makes such distributed memory systems operate as cohesive platforms. MPI facilitates both point-to-point communication, and efficient collective communication operations that improve performance and reduce program clutter. In its latest incarnation, MPI-3 also ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

The CUDA Handbook: A Comprehensive Guide to GPU Programming

The CUDA Handbook: A Comprehensive Guide to GPU Programming

Nicholas Wilt
PThreads Programming

PThreads Programming

Dick Buttlar, Jacqueline Farrell, Bradford Nichols

Publisher Resources

ISBN: 9780124171374