Apache Spark 2: Data Processing and Real-Time Analytics

How to do it...

1. Start a new project in IntelliJ or in an IDE of your choice. Make sure the necessary JAR files are included.

2. We define the package information for the Scala program:

package spark.ml.cookbook.chapter7

3. Import the necessary packages:

import java.text.DecimalFormat import org.apache.log4j.{Level, Logger} import org.apache.spark.sql.SparkSession import org.jfree.chart.{ChartFactory, ChartFrame, JFreeChart} import org.jfree.chart.axis.NumberAxis import org.jfree.chart.plot.PlotOrientation import org.jfree.data.xy.{XYSeries, XYSeriesCollection}

4. We now define a Scala case class to model the ratings data:

case class Rating(userId: Int, movieId: Int, rating: Float, timestamp: Long)

5. Let's define a function to display a JFreeChart ...