Big Data

Chapter 2

Storage and Database

Management for Big Data

∗

Vijay Gadepally

Jeremy Kepner

Albert Reuther

CONTENTS

2.1 Introduction ...................................................................... 16

2.2 Big Data Challenge ............................................................... 16

2.3 Systems Engineering for Big Data ................................................. 18

2.4 Disks and File Systems ............................................................ 19

2.4.1 Serial memory and storage ................................................ 19

2.4.2 Parallel storage: Lustre ................................................... 20

2.4.3 Parallel storage: ...