Frank Kane's Taming Big Data with Apache Spark and Python

Running the code

If you recall, I left myself a little cheat sheet in my script comments, telling me what I need to do, so let's go ahead and do all of that. The first thing I want to do is copy the script itself down. So I'm going to type in aws s3 cp s3://sundog-spark/MovieSimilarities1M.py./:

What that's going to do is go to S3 and copy my Python script and my driver script to this local directory here in my home directory:

I also need the lookup file for movie IDs to movie names, so let's do that next. Add aws s3 cp s3://sundog-spark /ml-1m/movies.dat ...