
54
leverAging the Crowd in soFtwAre testing
If you analyze the pros and cons of using an external crowd team
in this situation, you can easily come up with a list like that shown
in Table4.3.
As takeaways from this study,
15
both teams added value in their
own ways. In fact, in this specic example, the internal team was also
Table4.1 In-House vs. External Crowd Usability Testing: Premise
LAB USABILITY TEST CROWDSOURCED USABILITY TEST
Participants 5 55 (of which 14 were later found
to be spammers)
Participant demographics Students Crowd workers
Age range 24–33 19–51
Education level Bachelor’s degree and master’s
degree
All levels
Experience ...