MapReduce programming idiom
In the FP world, MapReduce is considered as a programming idiom.
Note
The process of mapping can be described as the application of a function or computation on each element of a sequence to produce a new sequence. Reduction gathers computed elements to produce the result of a process, algorithm, or a functional transformation.
In 2003, two Google engineers (Sanjay Ghemawat and Jeff Dean) published a paper about how the company used the MapReduce programming model to simplify their distributed programming tasks. The paper entitled MapReduce: Simplified Data Processing on Large Clusters is available on the public domain. This particular paper was very influential, and the Hadoop distributed programming model was based on ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access