May 2017
Beginner to intermediate
596 pages
15h 2m
English
Content preview from Data Lake for Enterprises
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
Start your free trial
Where we stand with Data Lake
This figure shows where we have reached with our Data Lake after covering part 2 of this book:
Figure 01: Data Lake implemented so far in this book
|
HDFS |
Distributed File Storage |
|
MapReduce |
Batch Processing Engine |
|
YARN |
Resource Negotiator |
|
HBase |
Columnar and Key Value NoSQL database that runs on HDFS |
|
Hive |
Query engine that provides SQL like access to HDFS |
|
Impala |
Fast Query Engine for analytical queries on HDFS |
|
Sqoop |
Data Acquisition and Ingestion |
|
Flume |
Data Acquisition and Ingestion via streamed flume events |
|
Kafka |
Highly Scalable Distributed Messaging Engine ... |