GPU-based Parallel Implementation of Swarm Intelligence Algorithms

Chapter 2

GPGPU: General-Purpose Computing on the GPU

Contents

2.1 Introduction  9

2.1.1 Multi-and Many-Core Era   10

2.1.2 GPUs as General-Purpose Computing Units   10

2.2 GPGPU Development Platforms  13

2.2.1 Stream Programming Model   14

2.2.2 GPGPU Development Platforms   15

2.3 Compute Unified Device Architecture (CUDA)  17

2.3.1 Kernels   18

2.3.2 Thread Hierarchy   18

2.3.3 Memory Hierarchy   19

2.3.4 Single-Instruction, Multiple-Thread (SIMT)   20

2.3.5 Libraries   21

2.3.6 Debugging and Profiling   23

2.4 Open Computing Language (OpenCL)  23

2.4.1 Device Hierarchy   23

2.4.2 Data Parallel Mode   24

2.4.3 Libraries   26

2.4.4 Profiling and Analysis Tools   27

2.5 Programming Techniques  27

2.5.1 Parallel Primitives   27

2.5.2 Data Structures ...