Practical Data Science with Python 3: Synthesizing Actionable Insights from Data

© Ervin Varga 2019

E. Varga Practical Data Science with Python 3https://doi.org/10.1007/978-1-4842-4859-1_5

5. Data Processing

Ervin Varga¹ 

(1)

Kikinda, Serbia

 

Data analysis is the central phase of a data science process. It is similar to the construction phase in software development, where actual code is produced. The focus is on being able to handle large volumes of data to synthesize an actionable insight and knowledge. Data processing is the major phase where math and software engineering skills interplay to cope with all sorts of scalability issues (size, velocity, complexity, etc.). It isn’t enough to simply pile up various technologies in the hope that all will auto-magically align and deliver the intended outcome. Knowing the basic paradigms ...