63

Data Structures for Big Data Stores

Arun A. Ravindran

University of North Carolina at Charlotte

Dinesh P. Mehta

Colorado School of Mines

63.1Introduction

63.2Data Models

63.3Partitioning

Consistent Hashing

63.4Replication and Consistency

Merkle Tree

63.5Persistence

Performance MetricsB+ TreesLog Structured Merge TreesIntuition behind LSMPerformance Optimizations

63.6Concurrency

63.7Conclusion

References

63.1Introduction

The emergence of large-scale web services, smartphones, social media, and high throughput scientific instruments within the last decade or so has resulted in a deluge of data. For example, Facebook has an incoming daily data rate of 600 TB with data warehouses storing upwards of 300 PB of data [1]. The amount of data generated ...

Get Handbook of Data Structures and Applications, 2nd Edition now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.