Skip to Main Content
High Performance Parallel I/O
book

High Performance Parallel I/O

by Prabhat, Quincey Koziol
October 2014
Intermediate to advanced content levelIntermediate to advanced
434 pages
13h 28m
English
Chapman and Hall/CRC
Content preview from High Performance Parallel I/O
70 High Performance Parallel I/O
6.2.4 The Curse of the Burst: Economic Thinking behind
Burst Buffers
HPC I/O currently is dominated by extreme bursts of data, not only in
the checkpoint workload but also in analysis workloads. Since I/O time is non-
productive time in general, the goal is to make I/O time minimal. As machine
memory sizes get bigger, from 1 PB of memory to exascale-class machines
with 50–100 PB of memory, the size of bursts is becoming enormous. Further,
given the shrinking job mean time to interrupt (JMTTI), for the checkpoint
use case, the time for the I/O burst is shrinking. Figure 6.2 shows the effect
of the ratio of JMMT over chec ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Heterogeneous System Architecture

Heterogeneous System Architecture

Wen-mei W. Hwu
Topics in Parallel and Distributed Computing

Topics in Parallel and Distributed Computing

Sushil K Prasad, Anshul Gupta, Arnold L Rosenberg, Alan Sussman, Charles C Weems
Embedded Computing for High Performance

Embedded Computing for High Performance

João Paiva Cardoso, José Figueiredo Coutinho, Pedro C. Diniz

Publisher Resources

ISBN: 9781466582347