Learning Data Mining with Python - Second Edition

The mrjob package

The mrjob package allows us to create MapReduce jobs that can easily be computed on Amazon's infrastructure. While mrjob sounds like a sedulous addition to the Mr. Men series of children's books, it stands for Map Reduce Job.

You can install mrjob using the following: pip install mrjob I had to install the filechunkio package separately using conda install -c conda-forge filechunkio, but this will depend on your system setup. There are other Anaconda channels for installing mrjob, check them with: anaconda search -t conda mrjob

In essence, mrjob provides the standard functionality that most MapReduce jobs need. Its most amazing feature is that you can write the same code, test on your local machine (without heavy infrastructure ...