Advanced Data Analytics Using Python: With Machine Learning, Deep Learning and NLP Examples

© Sayan Mukhopadhyay 2018

Sayan MukhopadhyayAdvanced Data Analytics Using Pythonhttps://doi.org/10.1007/978-1-4842-3450-1_7

7. Analytics at Scale

Sayan Mukhopadhyay¹ 

(1)

Kolkata, West Bengal, India

 

In recent decades, a revolutionary change has taken place in the field of analytics technology because of big data. Data is being collected from a variety of sources, so technology has been developed to analyze this data in a distributed environment, even in real time.

Hadoop

The revolution started with the development of the Hadoop framework, which has two major components, namely, MapReduce programming and the HDFS file system.

MapReduce Programming

MapReduce is a programming style inspired by functional programming to deal with large amounts of data. ...