HDF5 195
MC4 is a parallel particle-mesh cold dark matter (CDM) code based on
MC2 [6]. MC4 currently achieves scalable parallel performance for maximum
values of N
p
articles = N
g
rid = 4096
3
using O(10, 000) cores, and uses H5hut
to output several terabytes of particle and field data per timestep. Work is
progressing toward problem sizes of N
p
artcles = N
g
rid = 8192
3
or even larger
using O(100, 000) cores.
The HDF5-FastQuery [4] library enables multi-dimensional indexing
and searching on large H5Part datasets by leveraging an efficient bitmap in-
dexing technology called FastBit [16]. Storing bitmap indices directly in the
H5hut file significantly speeds up access to subsets of multi-dimensional data,
especially through range queries. This has been applied to ...