MapReduce Design Patterns

Index

A note on the digital index

A link in an index entry is displayed as the section title in which that entry appears. Because some sections have multiple index markers, it is not unusual for an entry to have several links to the same section. Clicking on any link will take you directly to the place in the text in which the marker appears.

A

access dates, partitioning users by, Partitioning users by last access date–Reducer code, Querying for user reputation by last access date–Driver code

anonymizing data, Motivation–Reducer code, Anonymous comments and distinct users–Driver code

antijoin operations, A Refresher on Joins

Apache Hadoop (see Hadoop)

audio, trends in nature of data, Images, Audio, and Video

averages, calculating, Average example–Data flow diagram

B

BigTable design (Google), Google BigTable

binning pattern

description, Pattern Description–Performance analysis

examples, Binning by Hadoop-related tags–Mapper code

Bloom filtering pattern

description, Pattern Description–Performance analysis

examples, Hot list–Mapper Code

reduce side joins with, Reputable user and comment join–Comment mapper code

Bloom filters

about, Overview

downsides, Downsides

tweaking, Tweaking Your Bloom Filter

use cases, Use Cases–Google BigTable

Bloom, Burton Howard, Overview

BloomFilter class, Bloom filter training

C

Cartesian product pattern

description, Pattern Description–Performance Analysis

examples, Comment Comparison–Mapper code

Cartesian products, A Refresher on Joins

chain folding

about, Chain Folding–Chain Folding ...