
20
Big Data: Storage, Sharing, and Security
2.4.2 Parallel storage: Lustre
Lustre is designed to meet the highest bandwidth file requirements on the largest systems in
the world [12] and is used for a variety of scientific workloads [49]. The open source Lustre
parallel file system presents itself as a standard POSIX, general-purpose file system and is
mounted by client computers running the Lustre client software. Files stored in Lustre contain
two components—metadata and object data. Metadata consists of the fields associated with
each file such as i-node, filename, file permissions, and timestamps. Object data consists of
the binary data stored in the