implement Kafka Consumer in streaming mode using Spark Streaming with Scala. The consumer
will consume incoming data and process those using Spark Streaming. We may plan to store the
data in NoSQL Cassandra.
The detailed solution approach is laid down in Figure 12.4.
12.4 NRT ANALYTICS: DETAILS OF SOLUTION
IMPLEMENTED
The NRT Analytics solution has been developed based on the technologies as mentioned below.
•Apache Spark: 2.1.0
•Apache Kafka: 1.1.0
•Scala: 2.11.8
•Apache Cassandra: 3.10
FIGURE 12.4 Solution approach
Customer data
source
KAFKA---Customer
data producer
KAFKA broker
KAFKA ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month, and much more.