Skip to Main Content
High Performance Parallel I/O
book

High Performance Parallel I/O

by Prabhat, Quincey Koziol
October 2014
Intermediate to advanced content levelIntermediate to advanced
434 pages
13h 28m
English
Chapman and Hall/CRC
Content preview from High Performance Parallel I/O
HDF5 195
MC4 is a parallel particle-mesh cold dark matter (CDM) code based on
MC2 [6]. MC4 currently achieves scalable parallel performance for maximum
values of N
p
articles = N
g
rid = 4096
3
using O(10, 000) cores, and uses H5hut
to output several terabytes of particle and field data per timestep. Work is
progressing toward problem sizes of N
p
artcles = N
g
rid = 8192
3
or even larger
using O(100, 000) cores.
The HDF5-FastQuery [4] library enables multi-dimensional indexing
and searching on large H5Part datasets by leveraging an efficient bitmap in-
dexing technology called FastBit [16]. Storing bitmap indices directly in the
H5hut file significantly speeds up access to subsets of multi-dimensional data,
especially through range queries. This has been applied to ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Heterogeneous System Architecture

Heterogeneous System Architecture

Wen-mei W. Hwu
Topics in Parallel and Distributed Computing

Topics in Parallel and Distributed Computing

Sushil K Prasad, Anshul Gupta, Arnold L Rosenberg, Alan Sussman, Charles C Weems
Embedded Computing for High Performance

Embedded Computing for High Performance

João Paiva Cardoso, José Figueiredo Coutinho, Pedro C. Diniz

Publisher Resources

ISBN: 9781466582347