Chapter 11

Designing GPU-Based Systems


Server environments are typically large, specially air conditioned rooms, often sealed against the excessive noise they generate. They consume hundreds of kilowatts to many megawatts of power. Typically, the computers are arranged by 1U, 2U, or 4U nodes, which slot into a large rack unit. These racks are often interconnected using a high-speed interconnect, such as InfiniBand, as shown in Figure 11.1.


FIGURE 11.1 Typical high-performance computing (HPC) setup.

Each node is connected to every other node within a given server by a high-speed switch. This can be something as simple as gigabit ...

Get CUDA Programming now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.