Chapter 6. Programming Practices

This chapter covers

  • Best practices unique to developing Hadoop programs
  • Debugging programs in local, pseudo-distributed, and fully distributed modes
  • Sanity checking and regression testing program outputs
  • Logging and monitoring
  • Performance tuning

Now that you’ve gone through various programming techniques in MapReduce, this chapter will step back and cover programming practices.

Programming on Hadoop differs from traditional programming mainly in two ways. First, Hadoop programs are primarily about processing data. Second, Hadoop programs are run over a distributed set of computers. These two differences will change some aspects of your development and debugging processes, which we cover in sections 6.1 ...

Get Hadoop in Action now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.