
OBJECTIVE
CHAPTER
6
Introducing Spark
andKafka
6.1 Introducing Spark
6.2 Working with Kafka
Now we have covered the core Big Data components,
such as Hadoop, MapReduce and NoSQL. It is the right
time to introduce another very important aspect of the
Hadoop ecosystem, i.e., Apache Spark. Spark is widely
used across organizations to process large data sets.
It is extremely popular for its great processing speed
and ability to integrate with diverse databases. Apache
Spark is accompanied by Apache Kafka, an open source
distributed streaming platform which is used to stream
data. Developed in Scala and Java by LinkedIn, it was
contributed to the ...