Technology stack
For the preceding solution, we would need to use various technologies. The details are as follows.
Kafka
Kafka is a publish-subscribe messaging service. It is distributed, reliable, durable, fast, and scalable by design. It gives us the ability to create topics and publish messages to them. We can then define the subscribers to these topics in order to start consuming these messages. More on Kafka at http://kafka.apache.org/.
Flume
Flume is a reliable, distributed system, designed to effectively collect and aggregate data from various systems. In our solution, we are going to use Flume to get data from Kafka and write it to HDFS and Open TSDB simultaneously. More on Flume at http://flume.apache.org/. We will be learning more about ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access