Model Performance Management with Explainable AI

Chapter 6. MPM and Responsible AI

One of the reasons that many companies are now considering MPM solutions is that it helps them get to an important end goal: not just implementing AI systems that are high quality and drive the bottom line of the business, but doing so responsibly. According to Accenture, corporate social responsibility and ethics are increasingly important to consumers—and if that isn’t enough, companies worldwide face a growing landscape of regulations around how AI can be implemented and used. But what is “Responsible AI,” and how can MPM help? Let’s take a look.

What Is Responsible AI?

Responsible AI is the practice of building AI that is transparent, accountable, ethical, and reliable. When AI is developed responsibly, stakeholders have insight into how decisions are made by the AI system, and the system is governable and auditable through human oversight. As a result, outcomes are fair to end users, stakeholders have visibility into the AI post-deployment, and the AI system continuously performs as expected in production.

Transparency ensures that stakeholders have visibility into what the AI system is doing. They understand the “why” behind the decisions and predictions made, and build systems with privacy and security built in. Accountability provides much-needed checks and balances for AI systems with guardrails, guidelines, and governance frameworks in place. Most importantly, there is human oversight and the ability to override decisions where needed. ...