O'Reilly logo

Hadoop Operations and Cluster Management Cookbook by Shumin Guo

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Configuring Fair Scheduler

Similar to CapacityScheduler, Fair Scheduler was designed to enforce fair shares of cluster resources in a multiuser environment. In this recipe, we will outline steps to configure Fair Scheduler for a Hadoop cluster.

Getting ready

We assume that our Hadoop cluster has been configured properly and all the daemons are running without any problems.

Log in to the master node from the Hadoop administrator machine using the following command:

ssh hduser@master

How to do it...

Perform the following steps to configure Hadoop Fair Scheduler:

  1. Enable fair scheduling by changing the following property in the file $HADOOP_HOME/conf/mapred-site.xml:
     <property> <name>mapred.jobtracker.taskScheduler</name> <value>org.apache.hadoop.mapred.FairScheduler</value> ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required