Beginning Apache Spark 3: With DataFrame, Spark SQL, Structured Streaming, and Spark Machine Learning Library

© The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature 2021

H. LuuBeginning Apache Spark 3https://doi.org/10.1007/978-1-4842-7383-8_1

1. Introduction to Apache Spark

Hien Luu¹  

(1)

SAN JOSE, CA, USA

 

There is no better time to learn Apache Spark than now. It has become one of the critical components in the big data stack due to its ease of use, speed, and flexibility. Over the years, it has established itself as the unified engine for multiple workload types, such as big data processing, data analytics, data science, and machine learning. Companies in many industries widely adopt this scalable data processing system, including Facebook, Microsoft, Netflix, and LinkedIn. Moreover, it has steadily improved through each ...