Collective Communication Support
Historically, the programmer of a distributed-memory multiprocessor has invoked various system primitives to send messages among processes executing on different nodes, resulting in a message-passing program. In order to simplify the programmer’s task and improve code portability, an alternative approach has been pursued whereby a sophisticated compiler generates data movement operations from shared-memory parallel programs. In order to support a portable and scalable software design across different platforms, the data parallel programming model, which is characterized by executing the same program on different processors with different data, is considered the most promising programming model for multicomputers. ...
Get Interconnection Networks now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
