Getting ready…
You need to finish the installation of the Redis Server as we described in the Downloading and installing Redis recipe in Chapter 1, Getting Started with Redis. You need to use the FLUSHALL command to flush all the data in your Redis instance before moving on to the next section.
The requirements of IDE and JDK are the same as in the Connecting to Redis with Spring Data Redis recipe. Only Scala APIs are available for Spark-Redis at the time of writing, so Scala v2.11 and the Scala plugin in IDEA are mandatory. In addition, basic knowledge of Spark and Scala is required for this recipe.
You can submit your job to a standalone Spark cluster or a Yarn cluster. For demo purposes, you can debug and run the Spark job in local mode ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access