Why You Need an AI Ethics Committee

by Reid Blackman

IN 2019 A STUDY published in the journal Science found that artificial intelligence from Optum, which many health systems were using to spot high-risk patients who should receive follow-up care, was prompting medical professionals to pay more attention to white people than to Black people. Only 18% of the people identified by the AI were Black, while 82% were white. After reviewing data on the patients who were actually the sickest, the researchers calculated that the numbers should have been about 46% and 53%, respectively. The impact was far-reaching: The researchers estimated that the AI had been applied to at least 100 million patients.

While the data scientists and executives involved ...

Get HBR's 10 Must Reads on AI (with bonus article "How to Win with Machine Learning" by Ajay Agrawal, Joshua Gans, and Avi Goldfarb) now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.