7 Working with the people annotating your data
This chapter covers
- Understanding in-house, contracted, and pay-per-task annotation workforces
- Motivating different workforces using three key principles
- Evaluating workforces when compensation is nonmonetary
- Evaluating your annotation volume requirements
- Understanding the training and/or expertise that annotators need for a given task
In the first two parts of this book, you learned how to select the right data for human review. The chapters in this part cover how to optimize that human interaction, starting with how to find and manage the right people to provide human feedback. Machine learning models often require thousands (and sometimes millions) of instances of human feedback to get the ...
Get Human-in-the-Loop Machine Learning now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
