© Michael Frampton 2018
Michael FramptonComplete Guide to Open Source Big Data Stack https://doi.org/10.1007/978-1-4842-2149-5_6

6. Processing

Michael Frampton1 
(1)
Paraparaumu, New Zealand
 

In this chapter, I will examine the processing function within a big data stack. I will concentrate on Apache Spark because it integrates well with both Apache Mesos and DCOS (dcos.io). I will expand on the work carried out in Chapter 4 to show how both Mesos and DCOS can be installed so that Apache-Spark-based frameworks can be installed into those environments and used.

This chapter will not teach you how to use Apache Spark; the aim here is to show how it can be integrated into a Mesos/DCOS environment and made ready to use. There are many books available that ...

Get Complete Guide to Open Source Big Data Stack now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.