
1.2 Convergence of Parallel Architectures 45
FIGURE 1.25 Typical organization of a data
parallel (SIMD) machine. Individual processing
elements (PEs) operate in lockstep under the di-
rection of a single control processor. Traditionally,
SIMD machines have provided a limited, regular
interconnect among the PEs, although this was
generalized in later machines, such as the Think-
ing Machines Corporation Connection Machine
and the MasPar.
as suggested by Figure 1.25. It was observed that many important scientific compu-
tations involved uniform calculation on every element of an array or matrix, often
involving neighboring elements in the row o