9.7.4. Methodology

Using Vividence's eXpress scripting/site evaluation tool (now part of the Keynote suite of Internet test and measurement tools), we created a 30-minute evaluation of the key transactions. Our test script featured a structured tour of the system, starting with a review of the new home page, progressing to logging into the application, and then completing a series of tasks that sponsors perform routinely.

The study was set up to gather quantitative performance data on how efficiently, consistently, and correctly users could complete the transactions in question, along with a qualitative satisfaction rating for performing the transactions and questions on changes or improvements users would suggest.

The study had 15 sections, ...

Get Beyond the Usability Lab now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.