Chapter 13. Management of Test Results and Defects
After test cases are executed, test results are reported and testing defects are resolved. Test cases consist of test logs generated automatically from the execution of automated test cases and results reported from manually executing each test step. A test result takes on the value of "pass" when the actual test results match the expected test results. Otherwise, the test result takes on the value of "fail." A successful test result with a value of pass indicates that the execution of the test case has successfully fulfilled the requirement. Test results with a value of fail will require analysis and can become defects. Depending on its priority or category, a defect has the potential to delay or postpone a system release date.
Defects are stored and managed in a secured system with database, reporting, and query capabilities. The Change Control Board (CCB) helps to manage, prioritize, assign, and categorize defects and subsequently determine how the defect will be resolved. The life cycle of a defect may include multiple states and handoffs among project members for initial testing, final validation, and approval before it is closed.
Reports are generated for all stored defects. Defect reports are useful for supporting the exit criteria for each testing phase. Reports for defects can show the trend for defects for a given time segment, the number of outstanding defects, and the closure rate for the defects.