Productive and Efficient Data Science with Python: With Modularizing, Memory profiles, and Parallel/GPU Processing

© The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature 2022

T. SarkarProductive and Efficient Data Science with Pythonhttps://doi.org/10.1007/978-1-4842-8121-5_2

2. Better Programming Principles for Efficient Data Science

Tirthajyoti Sarkar¹  

(1)

Fremont, CA, USA

 

The goal of this chapter is to introduce you to the concepts of certain programming styles and habits that play an essential part in developing efficient data science (DS) and machine learning (ML) systems and pipelines. I will illustrate the concepts through brief examples (or pseudo-codes wherever applicable) and talk about how to measure or track inefficiency.

I will start by introducing the concepts of time and space complexities (https://levelup.gitconnected.com/time-and-space-complexity-725dcba31902 ...