Skip to Main Content
Enterprise AI in the Cloud
book

Enterprise AI in the Cloud

by Rabi Jay
January 2024
Intermediate to advanced content levelIntermediate to advanced
528 pages
14h 8m
English
Wiley
Content preview from Enterprise AI in the Cloud

19Monitoring Models

What gets measured gets managed.

—Peter Drucker

This chapter deals with the critical components of monitoring, including making informed decisions around real-time and batch monitoring. It delves into checking the health of model endpoints, selecting appropriate performance metrics, and ensuring model freshness. To ensure the AI systems remain agile and responsive, you learn how to review and update features, automate endpoint changes, and scale on demand (see Figure 19.1).

An illustration depicting the monitoring of models with nine steps, each represented by a numbered circle. In the center is an enterprise A I journey map featuring deploy and monitor models with a small globe. The right side includes. 1. Deploy and monitor models. 2. Monitor and secure models. 3. Objective.

FIGURE 19.1: Monitoring models

MONITORING MODELS

Monitoring models is an essential aspect of MLOps to ensure that the model performs well and that the data used is high quality.

Importance of Monitoring Models in Production

Models are trained based on historical data, and we expect them to work in the same fashion on new data. However, in the real world, things are constantly changing, and hence there is a need to monitor the model and keep it updated. Here are some of the reasons to monitor the models:

  • Data drift can happen due to changes in input data with respect to training data.
  • Concept drift can happen due to changes in model performance.
  • Detect unfair bias introduced by the model.
  • Changing business needs may require a model to be updated. For example, a retailer may introduce new product lines that require a product recommendation model to be retrained.
  • New regulations ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

From ChatGPT to HackGPT: Meeting the Cybersecurity Threat of Generative AI

From ChatGPT to HackGPT: Meeting the Cybersecurity Threat of Generative AI

Karen Renaud, Merrill Warkentin, George Westerman
Generative AI for Cloud Solutions

Generative AI for Cloud Solutions

Paul Singh, Anurag Karuparti
Managing Cloud Native Data on Kubernetes

Managing Cloud Native Data on Kubernetes

Jeff Carpenter, Patrick McFadin
Cloud Identity Patterns and Strategies

Cloud Identity Patterns and Strategies

Giuseppe Di Federico, Fabrizio Barcaroli

Publisher Resources

ISBN: 9781394213054Purchase Link