Apache Spark Deep Learning Cookbook

How it works...

The following section explains how PySpark is modified to incorporate deep learning packages take a look at these steps:

1. Accessing bash allows us to make configurations at the command line, as seen in the following screenshot:

2. At the end of our document, we can see our original function, sparknotebook(), still intact; however, we need to modify it to incorporate the spark-deep-learning package.
3. Since this modification is to PySpark directly, and not to a Python library, we cannot incorporate it into our framework using a typical pip installation. Instead, we will modify our PySpark configuration to appear as shown in the ...