Chapter 3. Processing Data with Storm

This chapter will focus primarily on reading and processing the data using Storm. The key aspect being covered here will comprise of the ability of Storm to consume data from various sources, processing and transforming the same, and storing it to data stores. We will also help you to understand these concepts and give examples of filters, joins, and aggregators.

In this chapter, we will cover the following topics:

  • Storm input sources
  • Meet Kafka
  • Reliability of data processing
  • Storm simple patterns
  • Storm persistence

Storm input sources

Storm works well with a variety of input data sources. Consider the following examples:

  • Kafka
  • RabbitMQ
  • Kinesis

Storm is actually a consumer and process of the data. It has to be coupled ...

Get Real-Time Big Data Analytics now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.