Advanced Testing of Systems-of-Systems, Volume 1

5Quality Characteristics

The quality of a component, product or system and of a system-of-systems is not limited to its ability to do what is required of it – the functional aspect – but extends far beyond: it must ensure the security of data, the speed of execution, the volume of resources required, the ease of maintenance of its components, products or systems, etc. Quality is also perceived differently depending on the positioning of each (designer, supplier, user, etc.). Not to forget anything, there are various standards that define quality characteristics applicable to systems with preponderant software and systems-of-systems including software. Some of these standards are international and generic such as ISO25010, 2011, and others are specific to specific fields such as health (FDA Title 21 CFR Part 820), aeronautics (DO-178C/ED12C) or space (e.g. ECSS standards).

The test manager must ensure, in addition to compliance with the functional requirements, that the applicable standards are followed. Non-compliance with non-functional quality characteristics is almost always a source of dissatisfaction for users, while non-compliance with standards can lead to a ban on marketing (e.g. in the medical or aeronautical sectors). If a calculator gives the correct result (Feature) but the calculation time is too long (Performance), the calculator will be considered unusable.

Ensuring that each quality characteristic and its relative importance is identified involves an analysis ...