Advanced Testing of Systems-of-Systems, Volume 1

8Reporting

Reporting provides information on the current state of the project against a desired state defined during test planning, to make informed decisions about the project. The data reported must be adapted to the stakeholders, both in terms of level of detail and in terms of frequency, in order to allow them a quick and clear understanding, and sound decision-making.

8.1. Introduction

Throughout the test project, or even its various iterations (sprints, release trains, etc.), test campaigns and versions of the components, products or systems to be tested, the test manager must provide information on the progress of the test activities, the quality level of the product, and the optimal use of the resources allocated to it to carry out the tests.

Many questions will arise, such as (non-exhaustive list):

– What is the current quality of the product?

– Which components, products or systems will need more testing, where are there more defects and therefore where should we focus our efforts?

– What is the coverage achieved (components covered, functionalities available)?

– How efficient are the testing processes?

 - What is the current progress, and is it in line with initial forecasts?

 - How do you measure the effectiveness of your testers, components, products or systems under test?

 - How do you evaluate that the level of quality achieved for the components, products or systems under test corresponds to what is expected by customers?

 - How do you ascertain that the planned ...