Chapter 13. Testing and debugging


In this chapter
  • Using design and testing techniques to write bulletproof MapReduce code
  • Learning to debug issues in production and isolate problem inputs
  • Avoiding MapReduce anti-patterns


When you’re running MapReduce in production you can guarantee that some day you’ll receive a call about a failing job. The goal of this chapter is to help you put in as many measures as possible to avoid the chance of this happening. We’ll look at how to provide adequate unit testing for MapReduce code and examine some defensive coding techniques to minimize badly behaving code.

All the preparation and testing in the world doesn’t guarantee you won’t encounter any problems, and in the event that you do, we’ll look at ...

Get Hadoop in Practice now with the O’Reilly learning platform.

O’Reilly members experience live online training, plus books, videos, and digital content from nearly 200 publishers.