Skip to Main Content
Big Data Simplified
book

Big Data Simplified

by Sayan Goswami, Amit Kumar Das, Sourabh Mukherjee
June 2019
Beginner to intermediate content levelBeginner to intermediate
360 pages
10h 55m
English
Pearson Education India
Content preview from Big Data Simplified
70 | Big Data Simplied
To sum up, ‘Map’ is the step that is performed in parallel, and ‘Reduce’ is the step which
combines the intermediate results produced by the ‘Map’ phase. Each ‘Map’ phase output is
placed into intermediate state for intermediate events. These events are of three types, namely
shufing, sorting, partitioning and combining (overall, we can say ‘Group By’ with respect
to key’s). This intermediate event is handled by MapReduce framework itself and it actually
happened on each key but not on values. This Intermediate event is performed in local
le system of each DataNode, which means that the Map phase output
<key, value> ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Big Data

Big Data

James Warren, Nathan Marz
Practical Text Mining and Statistical Analysis for Non-structured Text Data Applications

Practical Text Mining and Statistical Analysis for Non-structured Text Data Applications

Gary D. Miner, John Elder, Andrew Fast, Thomas Hill, Robert Nisbet, Dursun Delen
Data Wrangling with Python

Data Wrangling with Python

Jacqueline Kazil, Katharine Jarmul

Publisher Resources

ISBN: 9789353941505