Deploying to the Edge

Performing machine learning and operations (MLOps) on a single computer can be challenging. When we think about training, deploying, and maintaining models across thousands of computers, the complexity of doing so can be daunting. Luckily, there are ways of reducing this complexity using tools such as containerization and continuous integration/continuous deployment (CI/CD) pipelines. In this chapter, we are going to discuss deploying models in a way that is secure, updatable, and optimized for the hardware at hand.

In terms of building updatable models, we are going to discuss using Azure IoT Hub Edge devices to enable over-the-air (OTA) updates across a single management plane. We are also going to use device twins ...

Get Artificial Intelligence for IoT Cookbook now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.