Frank Kane's Taming Big Data with Apache Spark and Python

Introducing the problem

I'm going to start you off with a pretty simple example here just to get your feet wet. What you're going to do is go to the download package for this book and find the customerorders.csv file. This just contains some random fake data that I generated. The input data in that file is going to look like this:

We have comma-separated fields of a customer ID, an item ID, and the amount spent on that item. What I want you to do is write a Spark script that consolidates that down to the total amount spent by customer ID. In the following example, we see the customer ID 44 appears twice and bought two items, one for $37.19 ...