O'Reilly logo

Hadoop Operations and Cluster Management Cookbook by Shumin Guo

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Monitoring a Hadoop cluster with Ganglia

Ganglia is an open source, scalable, and distributed monitoring system for clusters and computing grids. It has three major components: the monitoring daemon , the metadata daemon , and the web UI . In this recipe, we will outline steps to configure Ganglia for Hadoop cluster monitoring.

Getting ready

Log in to the master node from the administrator machine with the following command:

ssh hdadmin@master

Use the following yum command to install Ganglia on the master machine:

sudo yum install -y ganglia-gmond ganglia-gmetad ganglia-web

Install Ganglia monitoring daemon on all the slave nodes with the following commands:

for host in `cat $HADOOP_HOME/conf/slaves`
do
 echo ‘Installing Ganglia on host ‘ $host ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required