Apache Spark 2.x Machine Learning Cookbook

Reduce and grouping transformation with paired key-value RDDs

In this recipe, we explore reduce and group by key. The reduceByKey() and groupbyKey() operations are much more efficient and preferred to reduce() and groupBy() in most cases. The functions provide convenient facilities to aggregate values and combine them by key with less shuffling, which is problematic on large data sets.