O'Reilly logo

Learning Storm by Anand Nalya, Ankit Jain

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Chapter 8. Log Processing with Storm

In the previous chapter, we covered how we can integrate Storm with Redis and HBase. Also, we learned how to use Ganglia and JMX to monitor the Storm Cluster.

In this chapter, we will cover the most popular use case of Storm, that is, log processing.

This chapter covers the following topics:

  • Server log-processing elements
  • Producing the server log in Kafka
  • Splitting the server logfile
  • Identifying the country name, the operating system type, and the browser type
  • Extracting the searched keyword
  • Persisting the process data
  • Defining a topology and the Kafka spout
  • Deploying a topology
  • MySQL queries

Server log-processing elements

Log processing is becoming a need for every organization to collect business information from log ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required