May 2017
Beginner to intermediate
596 pages
15h 2m
English
Content preview from Data Lake for Enterprises
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
Start your free trial
Data Ingestion Layer
Data ingestion is the process of obtaining and importing data for immediate use or storage in a database. To ingest something is to "take something in or absorb something."
In Chapter 2, Comprehensive Concepts of a Data Lake you will have got a glimpse of the Data Ingestion Layer. This layer’s responsibility is to gather both stream and batch data and then apply any processing logic as demanded by your chosen use case. The following figure will refresh your memory and give you a good pictorial view of this layer:
Figure 01: Data Lake - Data Ingestion Layer
In our Data Lake implementation, the Data Ingestion ...