Chapter 25

Heterogeneous MPI application optimization with ITAC

Vadim Karpusenko    Colfax International, USA

Abstract

Utilization of Intel Xeon Phi coprocessor within the heterogeneous cluster environment with Intel Xeon processors or other compute devices requires corresponding workload balancing, to prevent idling of the coprocessors. This chapter demonstrates static and dynamic load balancing techniques, which can be used to address this issue. Static (manual) load balancing redistributes workload proportional to the compute capabilities of the compute units participating in the heterogeneous cluster. Dynamic load balancing, implemented with Boss-Workers workload distribution model, allows simple scaling of the Monte Carlo calculation of ...

Get High Performance Parallelism Pearls Volume One now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.