Artificial Intelligence for Big Data
by Anand Deshpande, Manish Kumar, Albenzo Coletta, Giancarlo Zaccone
Neural Network for Big Data
In the previous chapter, we established a basic foundation for our journey toward building intelligent systems. We differentiated the machine learning algorithms in two primary groups of supervised and unsupervised algorithms, and explored how the Spark programming model is a handy tool for us to implement these algorithms with a simple programming interface, along with a brief overview of the machine learning libraries available in Spark. We have also covered the fundamentals of regression analysis with a simple example and supporting code in Spark ML. The chapter showed how to cluster the data using the K-means algorithm and a deep dive into the realm of dimensionality reduction, which primarily helps us in representing ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access