Deep Learning Patterns and Practices

1 Designing modern machine learning

This chapter covers

• Evolving from classical AI to cutting-edge approaches
• Applying design patterns to deep learning
• Introducing the procedural reuse design pattern for modeling neural networks

The latest revolution in deep learning is at the macro level rather than the micro level, with the introduction of an approach that I coined while working at Google Cloud AI as model amalgamation. In this approach, models are broken into composable units that share and adapt components to achieve different objectives with the same initial data. The components are interconnected in a variety of connectivity patterns, in which each component learns communication interfaces between the models through design, without ...