Skip to Main Content
Big Data Simplified
book

Big Data Simplified

by Sayan Goswami, Amit Kumar Das, Sourabh Mukherjee
June 2019
Beginner to intermediate content levelBeginner to intermediate
360 pages
10h 55m
English
Pearson Education India
Content preview from Big Data Simplified
Introducing MapReduce | 77
4.3 PARALLELISM IN MAP AND REDUCE PHASES
Let us now briey discuss the map and reduce processes which run on a cluster. It should be
quite apparent that, the more parallel processes we run, the higher is the degree of optimization.
We have seen that map and reduce operations operate on key value pairs. A raw dataset of
profile views in a social networking site, like LinkedIn, might include a record for every time a
member views another member’s profile. However, assume that the final data that we are looking
for from that dataset is the cumulative number of views of every member’s profile as shown in
Figure 4.8.
FIGURE ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Big Data

Big Data

James Warren, Nathan Marz
Practical Text Mining and Statistical Analysis for Non-structured Text Data Applications

Practical Text Mining and Statistical Analysis for Non-structured Text Data Applications

Gary D. Miner, John Elder, Andrew Fast, Thomas Hill, Robert Nisbet, Dursun Delen
Data Wrangling with Python

Data Wrangling with Python

Jacqueline Kazil, Katharine Jarmul

Publisher Resources

ISBN: 9789353941505