October 2014
Intermediate to advanced
300 pages
8h 30m
English
CHAPTER 5
![]()
Addressing Application Bottlenecks: Distributed Memory
The first application optimization level accessible to the ever-busy performance analyst is the distributed memory one, normally expressed in terms of the Message Passing Interface (MPI).1 By its very nature, the distributed memory paradigm is concerned with communication. Some people consider all communication as overhead—that is, something intrinsically harmful that needs to be eliminated. We tend to call it “investment.” Indeed, by moving data around in the right manner, you hope to get more computational power in return. The main point, then, is to optimize this investment so ...
Read now
Unlock full access