O'Reilly logo

Building Recommendation Engines by Suresh Kumar Gorakala

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Model based recommender system using pyspark

Software details for the use case are as follows:

  • Spark 2.0
  • Python API: pyspark
  • Centos 6
  • Python 3.4

Start the Spark session using pyspark, as follows:

pyspark

The following screenshot shows the Spark session created by running the above pyspark command:

Model based recommender system using pyspark

To build the recommendation engine using Spark, we make use of Spark 2.0 capabilities, such as DataFrames, RDD, Pipelines, and Transforms available in Spark MLlib, which has was explained earlier.

Unlike earlier heurist approaches, such as k-nearest neighboring approaches used for building recommendation engines, in Spark, matrix factorization methods are used ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required