CHAPTER 3

Evolution of Two Technologies

3.1     Development Trend of Big Data Technology

In the era of big data, traditional software has been unable to process and mine information in large amounts of data. The most important change is Google’s ‘three carriages’. Google has successively released Google’s distributed file system (GFS), big data distributed computing framework MapReduce, and big data NoSQL database BigTable around 2004. These three papers have laid the cornerstone of big data technology. As we know, search engines mainly do two things, one is web page fetching, and the other is index building. In this process, there is a large amount of data to be stored and calculated. These three technologies are actually designed to solve ...

Get Blockchain for Big Data now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.