O'Reilly logo

Hadoop 2.x Administration Cookbook by Gurmukh Singh

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Fair Scheduler pools

In this recipe, we look at configuring Fair Scheduler with pools instead of queues. This is for backwards compatibility. In Hadoop 1.X, Fair Scheduler was addressed with pools and it means the same as queues.

It is recommended to use queues, as this is quite standard across the board. But, for the sake of the readers, it is good to cover the concepts of pools.

Getting ready

To go through the recipe, complete the previous recipe and just modify the fair-scheduler.xml file to reflect pools.

How to do it...

  1. Connect to the master1.cyrus.com master node in the cluster and switch as user hadoop.
  2. Edit the allocation file fair-scheduler.xml, as shown in the following screenshot:
  3. Copy the fair-scheduler.xml file to all the nodes in the cluster ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required