O'Reilly logo

Hadoop Operations and Cluster Management Cookbook by Shumin Guo

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Managing the MapReduce cluster

A typical MapReduce cluster is composed of one master node that runs the JobTracker and a number of slave nodes that run TaskTrackers. The task of managing a MapReduce cluster includes maintaining the health as well as the membership between TaskTrackers and the JobTracker. In this recipe, we will outline commands to manage a MapReduce cluster.

Getting ready

We assume that the Hadoop cluster has been properly configured and running.

Log in to the master node from the cluster administration machine using the following command:

ssh hduser@master

How to do it...

Perform the following steps to manage a MapReduce cluster:

  1. List all the active TaskTrackers using the following command:
    hadoop -job -list-active-trackers
    

    Note

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required