Data Lake for Enterprises

What is Apache Kafka?

Apache Kafka is an open-source stream processing platform developed by the Apache Software Foundation written in Scala and Java. The project aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds. Its storage layer is essentially a "massively scalable pub/sub message queue architected as a distributed transaction log," making it highly valuable for enterprise infrastructures to process streaming data.

- Wikipedia

The next sections of this chapter will definitely give you more details on what Kafka is in detail. In one sentence, Kafka gives a level of indirection, by which it disconnects the source from the consumer and also gives capability which a messaging layer should process, ...