With the preceding information, we can create a short checklist that can be used when creating fair models. Each issue comes with several sub-issues.
What is the goal of the model developers?
Is fairness an explicit goal?
Is the model evaluation metric chosen to reflect the fairness of the model?
How do model developers get promoted and rewarded?
How does the model influence business results?
Would the model discriminate against the developer's demographic?
How diverse is the development team?
Who is responsible when things go wrong?
Is the data biased?
How was the data collected?
Are there statistical misrepresentations in the sample?
Are sample sizes for minorities adequate?
Are sensitive variables included?
Can sensitive ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month, and much more.