May 2017
Beginner to intermediate
596 pages
15h 2m
English
Content preview from Data Lake for Enterprises
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
Start your free trial
Hadoop architecture in detail
We have now detailed each of the components in Hadoop in detail in the previous section. Now, it's time to discuss the Hadoop 2.x architecture in detail, looking at each of its components and sub-components.
The next figure delves into each component and sub-component in the Hadoop 2.x architecture in detail:
Figure 12: Low-level Hadoop 2.x conceptual architecture
The primary challenge that Hadoop 2.x solved over the Hadoop1 framework was around removing a single point of failure, which was the NameNode in Hadoop 1.x.
This has been achieved by the inclusion of the YARN framework as part of Hadoop 2.x. As seen ...