O'Reilly logo

Handbook of Data Structures and Applications, 2nd Edition by Sartaj Sahni, Dinesh P. Mehta

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

63

Data Structures for Big Data Stores

Arun A. Ravindran

University of North Carolina at Charlotte

Dinesh P. Mehta

Colorado School of Mines

63.1Introduction

63.2Data Models

63.3Partitioning

Consistent Hashing

63.4Replication and Consistency

Merkle Tree

63.5Persistence

Performance MetricsB+ TreesLog Structured Merge TreesIntuition behind LSMPerformance Optimizations

63.6Concurrency

63.7Conclusion

References

63.1Introduction

The emergence of large-scale web services, smartphones, social media, and high throughput scientific instruments within the last decade or so has resulted in a deluge of data. For example, Facebook has an incoming daily data rate of 600 TB with data warehouses storing upwards of 300 PB of data [1]. The amount of data generated ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required