January 2018
Beginner to intermediate
412 pages
9h 33m
English
There are 2 types of Spark operations:
Transformations specify general data manipulation operations such as filtering data, joining data, performing aggregations, sampling data, and so on. Transformations do not return any result when the line containing the transformation operation in the code is executed. Instead, the command, upon execution, supplements Spark's internal DAG with the corresponding operation request. Examples of common transformations include: map, filter, groupBy, union, coalesce, and many others.
Actions, on the other hand, return results. Namely, they execute the series of transformations (if any) that the user may have specified on the corresponding RDD and produce ...
Read now
Unlock full access