Chapter 7

Resource Management in Big Data Processing Systems

S. Tang; B. He; H. Liu; B.-S. Lee

Abstract

Resource management is a fundamental design issue for Big Data processing systems in the cloud. Different resource allocation policies can have significantly different impacts on performance and fairness. In this chapter, we first make an overview of existing Big Data processing and resource management systems. Next, we have a study on the economic fairness for large-scale resource management in the cloud, according to some desirable properties including sharing incentive, truthfulness, resource-as-you-pay fairness, and pareto efficiency. Both single- and multiresource management are studied for cloud computing. We show that the proposed ...

Get Big Data now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.