
Chapter 7
Development methodologies for GPU
and cluster of GPUs
Sylvain Contassot-Vivier
Universit´e Lorraine, Loria UMR 7503 & AlGorille INRIA Project Team,
Nancy, France
Stephane Vialle
SUPELEC, UMI GT-CNRS 2958 & AlGorille INRIA Project Team, Metz,
France
Jens Gustedt
INRIA Nancy–Grand Est, AlGorille INRIA Project Team, Strasbourg, France
7.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 106
7.2 General scheme of synchronous code with
computation/communication overlapping in GPU clusters . . . . . 106
7.2.1 Synchronous parallel algorithms on GPU clusters . . . . . . 106
7.2.2 Nativ ...