We will tell you the big data evolution story with Hadoop as the central theme.
Although it may feel like Hadoop is just a few years old going by the market buzz, in truth it is more than 10 years old. In 2003, Yahoo was doing a project called Nutch to address their web-search performance and scalability issue.
In 2003 and 2004, Google published its paper on Google's filesystem and MapReduce, respectively.
Nutch's developers started making the change using the design from Google's papers, which helped the process of scaling to more than just one machine. The solution worked to a very large extent, but still it wasn't a web-scale solution.
In 2006, Yahoo hired Doug Cutting to improve the web-search solution. He ...