95
deFeCt mAnAgement
the value is reaped without randomizing any of the entities involved.
e following metrics are denitely very useful in a crowd test eort
and are worth sharing selectively with the crowd to help them under-
stand how they are faring:
1. Bugs per tester versus valid bugs per tester (herein, if the
crowd is not exposed to the existing defect database, you
should not account for duplicate bugs as invalid bugs)
2. Number of valid bugs per tester by priority and severity
3. A rating around the level of detail and articulation provided
by the tester since he or she works remotely
4. Measures around the real end user value brought to the table
(which is one of the biggest reasons to crowd test your work)
5. Measures around ...