Designing Deep Learning Systems

2 Dataset management service

This chapter covers

• Understanding dataset management
• Using design principles to build a dataset management service
• Building a sample dataset management service
• Using open source approaches to dataset management

After our general discussion of deep learning systems, we are ready for the rest of the chapters, which focus on specific components in those systems. We present dataset management first not only because deep learning projects are data-driven but also because we want to remind you how important it is to think about data management before building other services.

Dataset management (DM) often gets overlooked in the deep learning model development process, whereas data processing and model training and serving ...