O'Reilly logo

Hadoop MapReduce v2 Cookbook - Second Edition by Thilina Gunarathne

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Chapter 4. Developing Complex Hadoop MapReduce Applications

In this chapter, we will cover the following recipes:

  • Choosing appropriate Hadoop data types
  • Implementing a custom Hadoop Writable data type
  • Implementing a custom Hadoop key type
  • Emitting data of different value types from a Mapper
  • Choosing a suitable Hadoop InputFormat for your input data format
  • Adding support for new input data formats – implementing a custom InputFormat
  • Formatting the results of MapReduce computations – using Hadoop OutputFormats
  • Writing multiple outputs from a MapReduce computation
  • Hadoop intermediate data partitioning
  • Secondary sorting – sorting Reduce input values
  • Broadcasting and distributing shared resources to tasks in a MapReduce job – Hadoop DistributedCache
  • Using Hadoop ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required