Machine Learning with PySpark: With Natural Language Processing and Recommender Systems

© The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature 2022

P. SinghMachine Learning with PySparkhttps://doi.org/10.1007/978-1-4842-7777-5_1

1. Introduction to Spark

Pramod Singh¹  

(1)

Bangalore, Karnataka, India

 

This is the introductory chapter to Spark in order to set the initial foundation for the rest of the chapters. This chapter is divided into three parts – understanding the evolution of data, core fundamentals of Spark along with its underlying architecture, and different ways to use Spark. We start by going through the brief history of data generation and how it has evolved in the last few decades. If we were to compare today, it certainly looks different from the days when the internet was still new and delete ...