O'Reilly logo

Hadoop Operations and Cluster Management Cookbook by Shumin Guo

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Chapter 6. Monitoring a Hadoop Cluster

In this chapter, we will cover:

  • Monitoring a Hadoop cluster with JMX
  • Monitoring a Hadoop cluster with Ganglia
  • Monitoring a Hadoop cluster with Nagios
  • Monitoring a Hadoop cluster with Ambari
  • Monitoring a Hadoop cluster with Chukwa

Introduction

System monitoring is critical for maintaining the health and availability for large distributed systems such as Hadoop. General monitoring tasks include monitoring the health of cluster nodes and networks, for example, the usage of memory, heap, CPU, network, and so on. For a Hadoop cluster, we may also want to monitor some specific metrics, such as the status of jobs and tasks in the cluster, the status of the JobTracker, TaskTracker, NameNode, and DataNode.

Hadoop is lucky ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required