GPUDirect
GPUDirect is an NVIDIA technology that was made to lower latency by bypassing CPU workloads to enable greater transfer speeds between GPUs.
Direct memory access (DMA) is a feature that allows hardware components of a computer system to access system RAM without having to harness the CPU.
The message passing interface (MPI) is a portable standard for invoking executable code through a process and its resources to function on diverse parallel-computing architectures. The process is notified via an invoking program. So, it is referred to as message-passing. The MPI standard was designed by researchers from both academia and industry.
GPUDirect Peer-to-Peer enables high-speed DMA transfers to copy data between the memories of two GPUs ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access