MLOps Engineering at Scale

10 Adopting PyTorch Lightning

This chapter covers

• Implementing PyTorch Lightning to reduce boilerplate code
• Adding training, validation, and test support for the DC taxi model
• Analyzing DC taxi model training and validation using pandas

Thus far, you have written your own implementation related to training and testing your machine learning model. However, much of the code you wrote was unrelated to your machine learning model architecture and could have applied to a broad range of distinct models. Building on this observation, this chapter introduces you to PyTorch Lightning, a framework that can help you reduce the amount of boilerplate engineering code in your machine learning system, and consequently help you focus on evolving your model ...