February 2026
Intermediate to advanced
384 pages
12h 48m
English
In Chapter 3, “Network Design Considerations,” we discussed design concepts involved in building an AI/ML data center. Optics and cables are important components of any data center, so requirements of an AI/ML data center.
With AI/ML clusters, the ports on a server currently support 200 Gbps and 400 Gbps throughput and are moving toward 800 Gbps and 1.6 Tbps throughput. Nvidia is the top vendor for the GPU server supplies for AI/ML clusters. It has multiple generations of GPUs—Volta, Ampere, Hopper, and Blackwell. Nvidia currently has A100 (Ampere) and H100 (Hopper) on the market and is moving toward H200 and further versions of GPU based on Blackwell.
From the GPU, Nvidia uses NVLink ...
Read now
Unlock full access