Monitoring a Hadoop cluster with Ganglia

Ganglia is an open source, scalable, and distributed monitoring system for clusters and computing grids. It has three major components: the monitoring daemon , the metadata daemon , and the web UI . In this recipe, we will outline steps to configure Ganglia for Hadoop cluster monitoring.

Getting ready

Log in to the master node from the administrator machine with the following command:

ssh hdadmin@master

Use the following yum command to install Ganglia on the master machine:

sudo yum install -y ganglia-gmond ganglia-gmetad ganglia-web

Install Ganglia monitoring daemon on all the slave nodes with the following commands:

for host in `cat $HADOOP_HOME/conf/slaves`
do
 echo ‘Installing Ganglia on host ‘ $host ...

Get Hadoop Operations and Cluster Management Cookbook now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.