March 2017
Beginner to intermediate
356 pages
7h 11m
English
We've used few transformation functions in the examples in this chapter, but I would like to share with you a list of the most commonly used transformation functions in Apache Spark. You can find a complete list of functions in the official documentation http://bit.ly/RDDTransformations.
|
Most Common Transformations | |
|
|
coalesce(numPartitions) |
|
|
repartition(numPartitions) |
|
|
repartitionAndSortWithinPartitions(partitioner) |
|
|
join(otherDataset, [numTasks]) |
|
|
cogroup(otherDataset, [numTasks]) |
|
|
cartesian(otherDataset) |
The map transformation is the most commonly used and the simplest of transformations ...
Read now
Unlock full access