Creating a supercomputer

This recipe turns four Raspberry Pis into a super computer using Apache Spark.

Apache Spark is a fast and general engine for large-scale data processing. In this recipe, Apache Spark is installed on four Raspberry Pis that have been networked into a small computer cluster. The cluster is then used to demonstrate the speed of super computing by calculating the value of pi using a Monte Carlo algorithm.

After completing this recipe, you will have a Raspberry Pi super computer.

Getting ready

The following ingredients are required to create a supercomputer:

  • Four basic networking setups for the Raspberry Pi
  • A high-speed network switch

This recipe does not require the desktop GUI and could either be run from the text-based console ...

Get Raspberry Pi Networking Cookbook - Second Edition now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.