Numerical considerations
Abstract
This chapter gives an overview of the floating-point numerical considerations in parallel programming. It introduces the concept of precision, which is determined by the format of the representation. It further introduces accuracy, which is determined by the hardware and software implementation of arithmetic operations. This is followed by some important CUDA features that can affect the speed and accuracy of an application. It then explains why parallel execution can result in different results than sequential execution. It also explains why sorting is used when it is critical to have very accurate results. Finally, it uses pivoting in the Gaussian Elimination method to illustrate the challenges for ...
Get Programming Massively Parallel Processors, 3rd Edition now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
