Skip to Main Content
Large Scale and Big Data
book

Large Scale and Big Data

by Sherif Sakr, Mohamed Gaber
June 2014
Intermediate to advanced content levelIntermediate to advanced
636 pages
23h 13m
English
Auerbach Publications
Content preview from Large Scale and Big Data
59MapReduce Family of Large-Scale Data-Processing Systems
2.3.5 eFFeCtive Data PlaCement
In the basic implementation of the Hadoop project, the objective of the data place-
ment policy is to achieve good load balance by distributing the data evenly across
the data servers, independently of the intended use of the data. This simple data
placement policy works well with most Hadoop applications that access just a sin-
gle le. However, there are some other applications that process data from multiple
les, which can get a signicant boost in performance with customized strategies.
In these applications, the absence of data colocation increases the data-shufing
costs, increases the network overhead, and reduces the effectiveness of data parti ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Reinventing the Organization for GenAI and LLMs

Reinventing the Organization for GenAI and LLMs

Ethan Mollick
Big Data Analytics for Internet of Things

Big Data Analytics for Internet of Things

Tausifa Jan Saleem, Mohammad Ahsan Chishti
Scala:Applied Machine Learning

Scala:Applied Machine Learning

Pascal Bugnion, Patrick R. Nicolas, Alex Kozlov
Topics in Parallel and Distributed Computing

Topics in Parallel and Distributed Computing

Sushil K Prasad, Anshul Gupta, Arnold L Rosenberg, Alan Sussman, Charles C Weems

Publisher Resources

ISBN: 9781466581500