Further high-performance computing techniques
There are many other high-performance computing techniques than those covered in this chapter. The IPython Cookbook contains many more details. Here is an overview of some of these other techniques:
MPI
The Message Passing Interface, or MPI, defines communication protocols for high-performance distributed systems. IPython.parallel has native support for MPI. Here are some other references:
- MPI tutorial at http://mpitutorial.com/
- MPI with IPython at http://ipython.org/ipython-doc/dev/parallel/parallel_mpi.html
Distributed computing
There are many frameworks for distributed computing and big data analysis in Python.
- Apache Spark is a big data framework that can run on Hadoop and has a Python API: http://spark.apache.org/ ...
Get Learning IPython for Interactive Computing and Data Visualization - Second Edition now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.