O'Reilly logo

Professional Hadoop Solutions by Alexey Yakubovich, Kevin T. Smith, Boris Lublinsky

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Contents

Chapter 1: Big Data and the Hadoop Ecosystem

Big Data Meets Hadoop

The Hadoop Ecosystem

Hadoop Core Components

Hadoop Distributions

Developing Enterprise Applications with Hadoop

Summary

Chapter 2: Storing Data in Hadoop

HDFS

HBase

Combining HDFS and HBase for Effective Data Storage

Using Apache Avro

Managing Metadata with HCatalog

Choosing an Appropriate Hadoop Data Organization for Your Applications

Summary

Chapter 3: Processing Your Data with MapReduce

Getting to Know MapReduce

Your First MapReduce Application

Designing MapReduce Implementations

Summary

Chapter 4: Customizing MapReduce Execution

Controlling MapReduce Execution with InputFormat

Reading Data Your Way with Custom RecordReaders

Organizing Output Data with Custom Output Formats

Writing Data Your Way with Custom RecordWriters

Optimizing Your MapReduce Execution with a Combiner

Controlling Reducer Execution with Partitioners

Using Non-Java Code with Hadoop

Summary

Chapter 5: Building Reliable MapReduce Apps

Unit Testing MapReduce Applications

Local Application Testing with Eclipse

Using Logging for Hadoop Testing

Reporting Metrics with Job Counters

Defensive Programming in MapReduce

Summary

Chapter 6: Automating Data Processing with Oozie

Getting to Know Oozie

Oozie Workflow

Oozie Coordinator

Oozie Bundle

Oozie Parameterization with Expression Language

Oozie Job Execution Model

Accessing Oozie

Oozie SLA

Summary

Chapter 7: Using Oozie

Validating Information about Places Using Probes

Designing Place Validation ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required