Monitoring a Hadoop cluster with Ganglia
Ganglia is an open source, scalable, and distributed monitoring system for clusters and computing grids. It has three major components: the monitoring daemon , the metadata daemon , and the web UI . In this recipe, we will outline steps to configure Ganglia for Hadoop cluster monitoring.
Log in to the master node from the administrator machine with the following command:
Use the following
yum command to install Ganglia on the master machine:
sudo yum install -y ganglia-gmond ganglia-gmetad ganglia-web
Install Ganglia monitoring daemon on all the slave nodes with the following commands:
for host in `cat $HADOOP_HOME/conf/slaves` do echo ‘Installing Ganglia on host ‘ $host ...