May 2017
Beginner to intermediate
596 pages
15h 2m
English
Content preview from Data Lake for Enterprises
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
Start your free trial
Why Apache Kafka
We are using Apache Kafka as the stream data platform (MOM: message-oriented middleware). Core reasons for choosing Kafka is it's high reliability and ability to deal with data with a very low latency.
Message-oriented middleware (MOM) is software or hardware infrastructure supporting the sending and receiving of messages between distributed systems.
- Wikipedia
Apache Kafka has some key attributes attached to it making it an ideal choice for us in achieving the capability that we are looking to implement the Data Lake. They are bulleted below:
- Scalability: Capable of handling high-velocity and high-volume data. Hundreds of megabytes per second throughput with terabytes of data.
- Distributed: Kafka is distributed by design ...