Software Testing Practice: Test Management

Software Testing Practice: Test Management

by Andreas Spillner, Tilo Linz, Thomas Rossner, Mario Winter
Released August 2007
Publisher(s): Rocky Nook
ISBN: 9781457118227

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

Aimed at experts who are dedicated to software testing, The Software Testing Process: Test Management addresses the major issues related to advanced, state-of-the-art test management. This book covers the syllabus required to pass the Certified Tester Examination - Advanced Level as defined by the International Software Testing Qualifications Board (ISTQB).

Software developers, project managers, quality managers, and team leaders will benefit from the comprehensive coverage of risk oriented management and the way testing is shown to be an integral, though independent part of software development.

Included are best practices in the field of testing, as well as detailed descriptions of involved tasks, roles, and responsibilities. Well suited for self-study, the reader is "taken by the hand" and guided through the key concepts and terminology of software testing in a variety of scenarios and case studies (as featured in the first book in this series, Software Testing Foundations).

Not only will testers and test managers find this a must-read, but anyone requiring advanced professional knowledge and skills in this field, anyone wanting to become a true testing professional, will find this book a must for a successful, well-founded education in advanced test management.

Topics include:

Test process and test toolsTesting in the software life cycleTest policy and test manualTest plan and test planningTest controlIncident managementRisk management/risk-based testingStaff qualificationsTest metrics

Table of contents

  1. Cover Page
  2. About the Authors
  3. Title Page
  4. Copyright Page
  5. Foreword by Stephan Goericke
  6. Foreword by Tim Koomen
  7. Foreword by Hans Schaefer
    1. Another book about test management, do we need this?
    2. Why do I like this book?
  8. Foreword
  9. Table of Contents
  10. 1 Introduction
    1. 1.1 Software Testing Foundations – Condensed
    2. 1.2 Software Testing Practice: Test Management – Overview
  11. 2 Test Process and Test Tools
    1. 2.1 Test Process Fundamentals
      1. 2.1.1 Test Planning and Control
      2. 2.1.2 Test Analysis and Design
      3. 2.1.3 Test Implementation and Execution
      4. 2.1.4 Test Evaluation and Test Report
      5. 2.1.5 Completing the Test Activities
    2. 2.2 Test Tools
      1. 2.2.1 Tools for Management and Test Control
      2. 2.2.2 Tools for Test Data and Test Script Specification
      3. 2.2.3 Tools for Static Testing
      4. 2.2.4 Tools for Dynamic Testing
      5. 2.2.5 Constraints to be Considered
    3. 2.3 Summary
  12. 3 Testing in the Software Life Cycle
    1. 3.1 Test and Development Process
    2. 3.2 Classification of Development Processes
    3. 3.3 The General V- Model
    4. 3.4 The W-Model
    5. 3.5 Rational Unified Process (RUP)
    6. 3.6 V-Model XT
    7. 3.7 Extreme Programming (XP)
    8. 3.8 Rapid Application Development (RAD)
    9. 3.9 Dynamic Systems Development Method (DSDM)
    10. 3.10 Summary
  13. 4 Test Policy and Test Handbook
    1. 4.1 Quality Policy and Test Policy
      1. ARM Quality Policy:
    2. 4.2 Bring the Test Policy to Life
      1. Relevance to Business Objectives
      2. Be Realistic
      3. Adequate Maturity
      4. Measurability
      5. Liveliness
    3. 4.3 Test Policy and Test Handbook
    4. 4.4 Summary
  14. 5 The Test Plan
    1. 5.1 General Test Plan Structure
      1. 5.1.1 From Strategy to Implementation
      2. 5.1.2 Strategic Parts of the Test Plan
      3. 5.1.3 The Test Schedule
      4. 5.1.4 The Level Test Plan
      5. 5.1.5 IEEE 829 – Standard for Test Documentation
    2. 5.2 Test Plan Contents
      1. 5.2.1 Test Plan Identifier
      2. 5.2.2 Introduction
      3. 5.2.3 Test Items
      4. 5.2.4 Features to Be Tested
      5. 5.2.5 Features Not to Be Tested
      6. 5.2.6 Approach
      7. 5.2.7 Item Pass/Fail Criteria
      8. 5.2.8 Suspension Criteria and Resumption Requirements
      9. 5.2.9 Test Deliverables
      10. 5.2.10 Testing Tasks
      11. 5.2.11 Environmental Needs
      12. 5.2.12 Responsibilities
      13. 5.2.13 Staffing and Training Needs
      14. 5.2.14 Schedule
      15. 5.2.15 Risks and Contingencies
      16. 5.2.16 Approvals
    3. 5.3 Defining a Test Strategy
    4. 5.4 Test Effort Estimation
      1. 5.4.1 Flat Models
      2. 5.4.2 Detailed Models Based on Test Activities
      3. 5.4.3 Models Based on Functional Volume
        1. Function Point Analysis (FPA)
        2. Test Point Analysis (TPA)
    5. 5.5 Organization of Test Teams and Test Levels
    6. 5.6 Test Planning as an Iterative Process Accompanying Development
      1. 5.6.1 Begin Test Activities Early and Refine Them Step-by-Step
      2. 5.6.2 “Plan-Do-Check-Act”-Cycles in Testing
    7. 5.7 Summary
  15. 6 Test Control
    1. 6.1 Initiating the Test Tasks
    2. 6.2 Monitoring the Test Progress
    3. 6.3 Reacting to Test Results
    4. 6.4 Reacting to Changed Circumstances
    5. 6.5 Evaluating Test Completion
    6. 6.6 Test Report
    7. 6.7 Summary
  16. 7 Assessing and Improving the Development and Test Processes
    1. 7.1 General Techniques and Approaches
      1. 7.1.1 Total Quality Management (TQM)
      2. 7.1.2 Kaizen
      3. 7.1.3 Six Sigma
    2. 7.2 Improving the Software Development Process
      1. 7.2.1 Capability Maturity Model Integration (CMMI)
        1. Testing in CMMI
        2. Verification
        3. Validation
        4. Test manager and CMMI
      2. 7.2.2 ISO/IEC 15504 (SPICE)
        1. Software Test (ENG.8)
        2. System Test (ENG.10)
        3. Test Manager and SPICE
      3. 7.2.3 Comparing CMMI with SPICE
    3. 7.3 Evaluation of Test Processes
      1. 7.3.1 Testing Maturity Model (TMM)™
        1. Maturity Goals and Maturity Sub-goals
        2. Maturity models in CMM and TMM
        3. TMM Assessment Model (TMM-AM)
      2. 7.3.2 Test Process Improvement® (TPI)
        1. Key Areas, Levels, Checkpoints
        2. TPI matrix
        3. TPI Assessment
        4. Improvement Techniques
      3. 7.3.3 Comparing TMM with TPI
    4. 7.4 Audits and Assessments
      1. 7.4.1 Performing an Internal Audit or Assessment
      2. 7.4.2 Preparing an External Audit or Assessment
    5. 7.5 Summary
  17. 8 Deviation Management
    1. 8.1 Terminology
    2. 8.2 Documenting Incidents
    3. 8.3 Incident Handling
      1. 8.3.1 Roles and Balance of Interests in Deviation Management
      2. 8.3.2 Generic Deviation Management Process
      3. 8.3.3 Using Deviation Management Tools
    4. 8.4 Standardized Classification for Software Anomalies According to the IEEE 1044/1044.1 Standard
      1. 8.4.1 Overview of the Classifications Process
      2. 8.4.2 Data Model: Categories, Classifications, and Supporting Data Items
      3. 8.4.3 Classification Steps in Detail
        1. Recognition
        2. Analysis
        3. Resolution
        4. Disposition
      4. 8.4.4 Tailoring of Standards
    5. 8.5 Summary
  18. 9 Risk Management and Risk-Oriented Testing
    1. 9.1 Introduction
    2. 9.2 Context Identification
    3. 9.3 Risk Identification
      1. 9.3.1 Risk Categories
      2. 9.3.2 Techniques and Utilities
    4. 9.4 Risk Analysis and Risk Evaluation
      1. 9.4.1 Analysis Techniques
      2. 9.4.2 Risk Occurrence Indicators
      3. 9.4.3 Risk Inventory
    5. 9.5 Risk Control and Treatment
    6. 9.6 Risk Review and Risk Monitoring
    7. 9.7 Risk-Oriented Test Plan Creation and Test Prioritization
    8. 9.8 Further Possibilities
      1. 9.8.1 Failure Modes and Effect Analysis (FMEA)
      2. 9.8.2 Risk-Based Test Effort Optimization
    9. 9.9 Summary
  19. 10 Staff Qualification and Skills
    1. 10.1 Individual Skills
    2. 10.2 Functional Team Roles
    3. 10.3 Social Team Roles
    4. 10.4 The Communication Factor
      1. Test-Team-External Communication
      2. Bad Style:
      3. Good Style:
      4. Test-Team-Internal Communication
    5. 10.5 The Motivation Factor
    6. 10.6 Summary
  20. 11 Test Metrics
    1. 11.1 Introduction
    2. 11.2 Some Measure Theory
    3. 11.3 Metrics Definition and Selection
    4. 11.4 Presenting Measurement Values
    5. 11.5 Several Test Metrics
      1. 11.5.1 Test-Case-Based Metrics
      2. 11.5.2 Test-Basis- and Test-Object-Based Metrics
      3. 11.5.3 Defect-Based Metrics
      4. 11.5.4 Cost- and Effort-Based Metrics
      5. 11.5.5 Evaluating Test Effectiveness
    6. 11.6 Residual Defect Estimations and Reliability
      1. 11.6.1 Residual Defect Probability
      2. 11.6.2 Reliability Growth Model
    7. 11.7 Summary
  21. 12 Selecting and Implementing Test Tools
    1. 12.1 Why Test Tools?
    2. 12.2 Evaluating and Selecting Test Tools
      1. 12.2.1 Principal Decision Whether to Use a Tool
        1. Identifying and Quantifying the Goals
        2. Considering Possible Alternative Solutions
        3. Cost-Benefit Analysis
        4. Identification of Constraints
      2. 12.2.2 Identifying the Requirements
        1. Functional Requirements of the Test Tool
        2. Nonfunctional Requirements of the Test Tool
        3. Requirements of Product Attendant Services
        4. Creating the Criteria Catalogue
      3. 12.2.3 Evaluation
        1. Selection of Evaluation Candidates
        2. Planning and Setup
        3. Tool Evaluation Based on Criteria
        4. Report Creation
      4. 12.2.4 Selecting the Tool to Be Procured
        1. Consolidating Evaluations and Preparing for Decision
        2. Decision Making
    3. 12.3 Introduction of Tools
      1. 12.3.1 Pilot Project
        1. The Coach (or Initiator)
        2. The Change Manager (or Integrator)
        3. The Tool Master
        4. The Sponsor
      2. 12.3.2 Distribution
    4. 12.4 Summary
  22. 13 Standards
    1. 13.1 Objectives and Positioning
    2. 13.2 Corporate Standards
    3. 13.3 Best Practices and Technical Specifications
    4. 13.4 Domain-Specific Standards
    5. 13.5 Generally Applicable Standards
      1. 13.5.1 Terminology and Contractual Standards
      2. 13.5.2 Process Standards
      3. 13.5.3 Product and Documentation Standards
      4. 13.5.4 Methods and Engineering Standards
      5. 13.5.5 Application of Standards
    6. 13.6 Summary
  23. Glossary
  24. Literature
  25. Standards
  26. WWW pages
  27. Index
  28. Footnotes
    1. Chapter 1
    2. Chapter 2
    3. Chapter 3
    4. Chapter 5
    5. Chapter 6
    6. Chapter 7
    7. Chapter 8
    8. Chapter 10
    9. Chapter 11
    10. Glossary

Product information

  • Title: Software Testing Practice: Test Management
  • Author(s): Andreas Spillner, Tilo Linz, Thomas Rossner, Mario Winter
  • Release date: August 2007
  • Publisher(s): Rocky Nook
  • ISBN: 9781457118227