Hadoop in Practice

Chapter 13. Testing and debugging

 

In this chapter

• Using design and testing techniques to write bulletproof MapReduce code
• Learning to debug issues in production and isolate problem inputs
• Avoiding MapReduce anti-patterns

 

When you’re running MapReduce in production you can guarantee that some day you’ll receive a call about a failing job. The goal of this chapter is to help you put in as many measures as possible to avoid the chance of this happening. We’ll look at how to provide adequate unit testing for MapReduce code and examine some defensive coding techniques to minimize badly behaving code.

All the preparation and testing in the world doesn’t guarantee you won’t encounter any problems, and in the event that you do, we’ll look at ...