5Reporting and Metrics

An essential aspect of the rollout and operation of a TAS is the objective evaluation of its success, quality, and added value. However, these measurements can only be used as a meaningful basis for decision-making if they are published in comprehensible reports and consistently taken into account by all the relevant stakeholders.

This chapter introduces the basic concepts of metrics and validity (section 5.1). It also provides examples of internal and external TAS metrics (section 5.2), it details how to implement them in a TAS (section 5.3), and how to publish and visualize them in the form of reports (section 5.4).

5.1Metrics and Validity

In theory, any measurement (i.e., the assignment of a numerical value based ...

Get Test Automation Fundamentals now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.