9

Energy Efficiency Scheduling in Hadoop

This chapter focuses on energy efficiency scheduling in Hadoop, including an introduction to Hadoop, scheduling algorithms, and the design and implementation of a Hadoop energy control system. Further, energy-efficient scheduling for multiple users is introduced, tested, and analyzed.

Keywords

Hadoop; MapReduce; MapReduce Slots; scheduling algorithm; energy-efficient scheduling; dynamic management

Main Contents of this Chapter:

• Hadoop introduction

• Scheduling algorithms

• Design and implementation of Hadoop energy control system

• Energy-efficient scheduling for multiple users

• Test and analysis of energy-efficient scheduling algorithms

9.1 Overview

9.1.1 Hadoop introduction

Hadoop is a distributed infrastructure ...

Get Optimized Cloud Resource Management and Scheduling now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.