The WordCount example
In this section, we present the MapReduce solution to the WordCount problem, sometimes called the Hello World example for MapReduce.
The diagram in Figure 11-2 shows the data flow for the WordCount program. On the left are two of the 80 files that are read into the program:
During the mapping stage, each word, followed by the number 1, is copied into a temporary file, one pair per line. Notice that many words are duplicated many times. For example, image
appears five times among the 80 files (including both files shown), so the string image 1
will appear four times in the temporary ...
Get Java Data Analysis now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.