
A PREDICTIVE METHOD TO MEASURE
RELATIVE EFFECTIVENESS
Nan Jiang
Software Research Centre, Bournemouth University, UK
Errors and completion are two widely used metrics for measuring the
effectiveness of a system in usability testing. Since the two measures
focus on different aspects of user output, a holistic view of “effec-
tiveness” is sometimes hard to establish in a comparative study which
eventually affects understanding different systems’ relative effec-
tiveness. The paper proposes a predictive method using an adapted
confusion matrix to establish a correlation model to measure a sys-
tem’s relative effectiveness based on its own performance prediction. ...