Appendix BA Brief Introduction to MPI
B.2 GETTING STARTED
B.3 BASIC POINT-TO-POINT MESSAGE PASSING
B.4 COLLECTIVE OPERATIONS
B.5 ADVANCED POINT-TO-POINT MESSAGE PASSING
B.6 MPI AND FORTRAN
MPI (Message Passing Interface) is the standard programming environment for distributed-memory parallel computers. The central construct in MPI is message passing: One process1 packages information into a message and sends that message to another process. MPI, however, includes far more than simple message passing. MPI includes routines to synchronize processes, sum numbers distributed among a collection of processes, scatter data across a collection of processes, and much more.
1 The UEs are processes in MPI.
MPI was created ...