In this chapter, I will examine the processing function within a big data stack. I will concentrate on Apache Spark because it integrates well with both Apache Mesos and DCOS (dcos.io). I will expand on the work carried out in Chapter 4 to show how both Mesos and DCOS can be installed so that Apache-Spark-based frameworks can be installed into those environments and used.
This chapter will not teach you how to use Apache Spark; the aim here is to show how it can be integrated into a Mesos/DCOS environment and made ready to use. There are many books available that ...