CHAPTER 13

image

Troubleshooting Job Failures

There are different types of jobs you can submit to your HDInsight cluster, and it is inevitable that you will run into problems every now and then while doing so. Though most HDInsight jobs are internally executed as MapReduce jobs, there are different techniques for troubleshooting high-level supporting projects like Hive, Pig, Oozie, and others that make life easier for the developer. In this chapter, you will learn to troubleshoot the following types of failures:

  • MapReduce job failures
  • Hive job failures
  • Pig job failures
  • Sqoop job failures
  • Windows Azure Storage Blob failures
  • Cluster connectivity failures ...

Get Pro Microsoft HDInsight: Hadoop on Windows now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.