Preface
Every industry, company, and consumer has been impacted by artificial intelligence (AI). According to The State of AI 2019: Divergence, 1 in 10 enterprises currently use 10 or more AI applications. According to Gartner, 75% of businesses are expected to shift from piloting to operationalizing AI by 2024. How many AI applications does your company currently operate?
AI has the potential to provide productive, efficient, and innovative solutions to our everyday problems, but it comes with its risks. We’ve seen multiple examples in the past few years of alleged bias in AI. One high-profile example was the Apple Card/Goldman Sachs scandal in 2019, where what started as a tweet thread with multiple reports of alleged bias eventually led to a regulator opening an investigation into algorithm prediction practices at Goldman Sachs. And this isn’t an isolated instance; there have also been reports about Amazon’s biased hiring algorithm, racial bias in healthcare algorithms, and bias in AI for judicial decisions.
These issues might have been avoided if humans had visibility into every stage of the system life cycle. Part of that life cycle involves training a machine learning (ML) model to help in making decisions. In the model validation stage, teams could have unearthed instances of unwanted model behavior. With visibility into model performance online and offline, these sorts of unwanted behaviors can be detected and managed early on.
For each high-profile case that comes under ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access