July 2021
Intermediate to advanced
704 pages
21h 6m
English
Overview
Complex calculations, like training deep learning models or running large-scale simulations, can take an extremely long time. Efficient parallel programming can save hours—or even days—of computing time. Parallel and High Performance Computing shows you how to deliver faster run-times, greater scalability, and increased energy efficiency to your programs by mastering parallel techniques for multicore processor and GPU hardware.
About the Technology
Write fast, powerful, energy efficient programs that scale to tackle huge volumes of data. Using parallel programming, your code spreads data processing tasks across multiple CPUs for radically better performance. With a little help, you can create software that maximizes both speed and efficiency.
About the Book
Parallel and High Performance Computing offers techniques guaranteed to boost your code’s effectiveness. You’ll learn to evaluate hardware architectures and work with industry standard tools such as OpenMP and MPI. You’ll master the data structures and algorithms best suited for high performance computing and learn techniques that save energy on handheld devices. You’ll even run a massive tsunami simulation across a bank of GPUs.
What's Inside
About the Reader
For experienced programmers proficient with a high-performance computing language like C, C++, or Fortran.
About the Authors
Robert Robey works at Los Alamos National Laboratory and has been active in the field of parallel computing for over 30 years. Yuliana Zamora is currently a PhD student and Siebel Scholar at the University of Chicago, and has lectured on programming modern hardware at numerous national conferences.
Quotes
If you want to learn about parallel programming and high-performance computing based on practical and working examples, this book is for you.
- Tuan A. Tran, ExxonMobil
A great survey of recent advances on parallel and multi-processor software techniques.
- Albert Choy, OSI Digital Grid Solutions
An in-depth treatise on parallel computing from both a software- and hardware-optimized standpoint.
- Jean François Morin, Laval University
This book will show you how to design code that takes advantage of all the computing power modern computers offer.
- Alessandro Campeis, Vimar
About the Technology
Write fast, powerful, energy efficient programs that scale to tackle huge volumes of data. Using parallel programming, your code spreads data processing tasks across multiple CPUs for radically better performance. With a little help, you can create software that maximizes both speed and efficiency.
About the Book
Parallel and High Performance Computing offers techniques guaranteed to boost your code’s effectiveness. You’ll learn to evaluate hardware architectures and work with industry standard tools such as OpenMP and MPI. You’ll master the data structures and algorithms best suited for high performance computing and learn techniques that save energy on handheld devices. You’ll even run a massive tsunami simulation across a bank of GPUs.
What's Inside
- Planning a new parallel project
- Understanding differences in CPU and GPU architecture
- Addressing underperforming kernels and loops
- Managing applications with batch scheduling
About the Reader
For experienced programmers proficient with a high-performance computing language like C, C++, or Fortran.
About the Authors
Robert Robey works at Los Alamos National Laboratory and has been active in the field of parallel computing for over 30 years. Yuliana Zamora is currently a PhD student and Siebel Scholar at the University of Chicago, and has lectured on programming modern hardware at numerous national conferences.
Quotes
If you want to learn about parallel programming and high-performance computing based on practical and working examples, this book is for you.
- Tuan A. Tran, ExxonMobil
A great survey of recent advances on parallel and multi-processor software techniques.
- Albert Choy, OSI Digital Grid Solutions
An in-depth treatise on parallel computing from both a software- and hardware-optimized standpoint.
- Jean François Morin, Laval University
This book will show you how to design code that takes advantage of all the computing power modern computers offer.
- Alessandro Campeis, Vimar
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.