Effective Data Science Infrastructure

9 Machine learning with the full stack

This chapter covers

• Developing a custom framework that makes it easier to develop models and features for a particular problem domain
• Training a deep learning model in a workflow
• Summarizing the lessons learned in this book

We have now covered all layers of the infrastructure stack, shown in figure 9.1, except the topmost one: model development. We only scratched the surface of the feature engineering layer in chapter 7. Isn’t it paradoxical that a book about machine learning and data science infrastructure spends so little time talking about the core concerns of machine learning: models and features?

The focus is deliberate. First, many excellent books already exist about these topics. Mature modeling ...