Remote Usability Testing

Were there any "false positives"?

False positives are cases where a participant completes the task, and finds it easy to do so, but actually completed it wrong or completed another task without having any clue that it was wrong. If the task was completed wrongly without the study participant being aware of it, then this is a usability issue that needs to be reported on, whereas if the study participant erroneously completed another task, then those responses need to be excluded from the report. The latter has happened to us when a study participant called up the live website of the product under testing instead of using the prototype link provided to them, for example, or where the staging environment had links to the production site and ...