O'Reilly logo

Hadoop 2.x Administration Cookbook by Gurmukh Singh

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Chapter 5. Schedulers

In this chapter, we will cover the following recipes:

  • Configuring users and groups
  • Fair Scheduler configuration
  • Fair Scheduler pools
  • Configuring job queues
  • Job queue ACLs
  • Configuring Capacity Scheduler
  • Queuing mappings in Capacity Scheduler
  • YARN and Mapred commands
  • YARN label-based scheduling
  • YARN SLS

Introduction

In this chapter, we will configure YARN schedulers and job queues so that multiple users can use the cluster at the same time and make a legitimate use of the resources provided to them. There are two approaches: either setup a separate cluster for different business units or share the clusters.

The first approach is fine if there are a few clusters, but managing a large number of clusters is challenging. A better approach is ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required