Field Guide to Hadoop

Field Guide to Hadoop

by Kevin Sitto, Marshall Presser
Released March 2015
Publisher(s): O'Reilly Media, Inc.
ISBN: 9781491947883

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

If your organization is about to enter the world of big data, you not only need to decide whether Apache Hadoop is the right platform to use, but also which of its many components are best suited to your task. This field guide makes the exercise manageable by breaking down the Hadoop ecosystem into short, digestible sections. You’ll quickly understand how Hadoop’s projects, subprojects, and related technologies work together.

Each chapter introduces a different topic—such as core technologies or data transfer—and explains why certain components may or may not be useful for particular needs. When it comes to data, Hadoop is a whole new ballgame, but with this handy reference, you’ll have a good grasp of the playing field.

Topics include:

  • Core technologies—Hadoop Distributed File System (HDFS), MapReduce, YARN, and Spark
  • Database and data management—Cassandra, HBase, MongoDB, and Hive
  • Serialization—Avro, JSON, and Parquet
  • Management and monitoring—Puppet, Chef, Zookeeper, and Oozie
  • Analytic helpers—Pig, Mahout, and MLLib
  • Data transfer—Scoop, Flume, distcp, and Storm
  • Security, access control, auditing—Sentry, Kerberos, and Knox
  • Cloud computing and virtualization—Serengeti, Docker, and Whirr

Publisher resources

View/Submit Errata

Table of contents

  1. Preface
    1. Conventions Used in This Book
    2. Safari® Books Online
    3. How to Contact Us
    4. Acknowledgments
  2. 1. Core Technologies
    1. Hadoop Distributed File System (HDFS)
      1. Tutorial Links
      2. Example Code
    2. MapReduce
      1. Tutorial Links
      2. Example Code
    3. YARN
      1. Tutorial Links
      2. Example Code
    4. Spark
      1. Tutorial Links
      2. Example Code
  3. 2. Database and Data Management
    1. Cassandra
      1. Tutorial Links
      2. Example Code
    2. HBase
      1. Tutorial Links
      2. Example Code
    3. Accumulo
      1. Tutorial Links
      2. Example Code
    4. Memcached
      1. Tutorial Links
      2. Example Code
    5. Blur
      1. Tutorial Links
      2. Example Code
    6. Solr
      1. Tutorial Links
      2. Example Code
    7. MongoDB
      1. Tutorial Links
      2. Example Code
    8. Hive
      1. Tutorial Links
      2. Example Code
    9. Spark SQL (formerly Shark)
      1. Tutorial Links
      2. Example Code
    10. Giraph
      1. Tutorial Links
  4. 3. Serialization
    1. Avro
      1. Tutorial Links
      2. Example Code
    2. JSON
      1. Tutorial Links
      2. Example Code
    3. Protocol Buffers (protobuf)
      1. Tutorial Links
      2. Example Code
    4. Parquet
      1. Tutorial Links
      2. Example Code
  5. 4. Management and Monitoring
    1. Ambari
      1. Tutorial Links
      2. Example Code
    2. HCatalog
      1. Tutorial Links
      2. Example Code
    3. Nagios
      1. Tutorial Links
    4. Puppet
      1. Tutorial Links
      2. Example Code
    5. Chef
      1. Tutorial
      2. Example Code
    6. ZooKeeper
      1. Tutorial Links
      2. Example Code
    7. Oozie
      1. Tutorial Links
      2. Example Code
    8. Ganglia
      1. Tutorial Links
      2. Example Code
  6. 5. Analytic Helpers
    1. MapReduce Interfaces
    2. Analytic Libraries
    3. Pig
      1. Tutorial Links
      2. Example Code
    4. Hadoop Streaming
      1. Tutorial Links
      2. Example Code
    5. Mahout
      1. Tutorial Links
      2. Example Code
    6. MLLib
      1. Tutorial Links
      2. Example Code
    7. Hadoop Image Processing Interface (HIPI)
      1. Tutorial Links
      2. Example Code
    8. SpatialHadoop
      1. Tutorial Links
  7. 6. Data Transfer
    1. Sqoop
      1. Tutorial Links
      2. Example Code
    2. Flume
      1. Tutorial Links
      2. Example Code
    3. DistCp
      1. Tutorial Links
      2. Example Code
    4. Storm
      1. Tutorial Links
      2. Example Code
  8. 7. Security, Access Control, and Auditing
    1. Sentry
      1. Tutorial Links
      2. Example Code
    2. Kerberos
      1. Tutorial Links
      2. Example Code
    3. Knox
      1. Tutorial Links
      2. Example Code
  9. 8. Cloud Computing and Virtualization
    1. Serengeti
      1. Tutorial Links
    2. Docker
      1. Tutorial Links
      2. Example Code
    3. Whirr
      1. Tutorial Links
      2. Example Code

Product information

  • Title: Field Guide to Hadoop
  • Author(s): Kevin Sitto, Marshall Presser
  • Release date: March 2015
  • Publisher(s): O'Reilly Media, Inc.
  • ISBN: 9781491947883