Chapter 11

Designing GPU-Based Systems

Introduction

Server environments are typically large, specially air conditioned rooms, often sealed against the excessive noise they generate. They consume hundreds of kilowatts to many megawatts of power. Typically, the computers are arranged by 1U, 2U, or 4U nodes, which slot into a large rack unit. These racks are often interconnected using a high-speed interconnect, such as InfiniBand, as shown in Figure 11.1.

image

FIGURE 11.1 Typical high-performance computing (HPC) setup.

Each node is connected to every other node within a given server by a high-speed switch. This can be something as simple as gigabit ...

Get CUDA Programming now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.