Book description
Hadoop: The Definitive Guide helps you harness the power of your data. Ideal for processing large datasets, the Apache Hadoop framework is an open source implementation of the MapReduce algorithm on which Google built its empire. This comprehensive resource demonstrates how to use Hadoop to build reliable, scalable, distributed systems: programmers will find details for analyzing large datasets, and administrators will learn how to set up and run Hadoop clusters.
Complete with case studies that illustrate how Hadoop solves specific problems, this book helps you:
- Use the Hadoop Distributed File System (HDFS) for storing large datasets, and run distributed computations over those datasets using MapReduce
- Become familiar with Hadoop's data and I/O building blocks for compression, data integrity, serialization, and persistence
- Discover common pitfalls and advanced features for writing real-world MapReduce programs
- Design, build, and administer a dedicated Hadoop cluster, or run Hadoop in the cloud
- Use Pig, a high-level query language for large-scale data processing
- Take advantage of HBase, Hadoop's database for structured and semi-structured data
- Learn ZooKeeper, a toolkit of coordination primitives for building distributed systems
If you have lots of data -- whether it's gigabytes or petabytes -- Hadoop is the perfect solution. Hadoop: The Definitive Guide is the most thorough book available on the subject.
"Now you have the opportunity to learn about Hadoop from a master-not only of the technology, but also of common sense and plain talk."-- Doug Cutting, Hadoop Founder, Yahoo!
Table of contents
- Dedication
- A Note Regarding Supplemental Files
- Foreword
- Preface
- 1. Meet Hadoop
- 2. MapReduce
- 3. The Hadoop Distributed Filesystem
- 4. Hadoop I/O
- 5. Developing a MapReduce Application
- 6. How MapReduce Works
- 7. MapReduce Types and Formats
- 8. MapReduce Features
- 9. Setting Up a Hadoop Cluster
- 10. Administering Hadoop
- 11. Pig
- 12. HBase
- 13. ZooKeeper
-
14. Case Studies
- Hadoop Usage at Last.fm
- Hadoop and Hive at Facebook
- Nutch Search Engine
- Log Processing at Rackspace
- Cascading
- TeraByte Sort on Apache Hadoop
- A. Installing Apache Hadoop
- B. Cloudera’s Distribution for Hadoop
- C. Preparing the NCDC Weather Data
- Index
- About the Author
- Colophon
- Copyright
Product information
- Title: Hadoop: The Definitive Guide
- Author(s):
- Release date: June 2009
- Publisher(s): O'Reilly Media, Inc.
- ISBN: 9780596521974
You might also like
book
Hadoop: The Definitive Guide, 2nd Edition
Discover how Apache Hadoop can unleash the power of your data. This comprehensive resource shows you …
book
Hadoop: The Definitive Guide, 3rd Edition
Ready to unlock the power of your data? With this comprehensive guide, you’ll learn how to …
book
Mastering Hadoop
Go beyond the basics and master the next generation of Hadoop data processing platforms In Detail …
book
Hadoop Application Architectures
Get expert guidance on architecting end-to-end data management solutions with Apache Hadoop. While many sources explain …