Designing GPU-Based Systems
Server environments are typically large, specially air conditioned rooms, often sealed against the excessive noise they generate. They consume hundreds of kilowatts to many megawatts of power. Typically, the computers are arranged by 1U, 2U, or 4U nodes, which slot into a large rack unit. These racks are often interconnected using a high-speed interconnect, such as InfiniBand, as shown in Figure 11.1.
FIGURE 11.1 Typical high-performance computing (HPC) setup.
Each node is connected to every other node within a given server by a high-speed switch. This can be something as simple as gigabit ...