book

Improving the Test Process

by Graham Bath, Erik Van Veenendaal

December 2013

Intermediate to advanced

432 pages

10h 34m

English

Rocky Nook

Read now

Unlock full access

Front Cover
Half Title
Title Page
Copyright
Contents
Preface
Acknowledgements
1 Introduction
1.1 About the Authors1.1.1 Erik van Veenendaal1.1.2 Graham Bath1.2 Purpose of the Book1.3 What Is an Expert?1.4 Expectations and Business Outcomes1.5 Career Paths for Testers1.6 Syllabus Parts1.7 The Certification Exam1.8 Certification
2 The Context of Improvement
2.1 Why Improve Testing?2.2 What Can Be Improved?2.3 Views on Quality2.4 The Generic Improvement Process2.4.1 The Deming Cycle2.4.2 The IDEAL Improvement Framework2.4.3 Fundamental Concepts of Excellence2.5 Overview of Improvement Approaches2.5.1 Overview of Model-Based Approaches2.5.2 Overview of Analytical Approaches2.5.3 Hybrid Approaches2.5.4 Other Approaches to Improving the Test Process2.6 Exercises
3 Model-Based Improvement
3.1 Introduction to Test Process Improvement Models3.1.1 Desirable Characteristics of Test Process Improvement Models3.1.2 Using Models: Benefits and Risks3.1.3 Categories of Models3.2 Software Process Improvement (SPI) Models3.2.1 Capability Maturity Model Integration (CMMI)3.2.2 ISO/IEC 155043.2.3 Comparing CMMI and ISO/IEC 155043.3 Test Process Improvement Models3.3.1 The Test Process Improvement Model (TPI NEXT)3.3.2 Test Maturity Model integration (TMMi)3.3.3 Comparing TPI NEXT to TMMi3.3.4 Systematic Test and Evaluation Process (STEP)3.3.5 Critical Testing Processes (CTP)3.4 Comparing Process Models and Content Models3.5 Suitability of SPI Models and Test Process Improvement Models3.6 Exercises

4 Analytical-Based Improvement
4.1 Introduction4.2 Causal Analysis4.2.1 Selecting Items for Causal Analysis4.2.2 Gathering and Organizing the Information4.2.3 Identifying Root Causes4.2.4 Drawing Conclusions4.2.5 Causal Analysis with System Diagrams4.2.6 Causal Analysis during Formal Reviews4.2.7 Causal Analysis Lessons Learned4.3 GQM Approach4.3.1 Introduction4.3.2 Paradigms4.3.3 GQM Process4.3.4 Supporting Tools and Techniques4.3.5 Bottom-Up Improvement4.4 Analysis Using Measures, Metrics, and Indicators4.4.1 Test Effectiveness Metrics4.4.2 Test Efficiency / Cost Metrics4.4.3 Lead-Time Metrics4.4.4 Predictability Metrics4.4.5 Product Quality Metrics4.4.6 Test Maturity Metrics4.5 Exercises
5 Selecting Improvement Approaches
5.1 Selecting Test Process Improvement Approaches5.2 Process Models5.3 Content Models5.4 Analytical Approaches5.5 Mixed Approaches5.6 Analytical Approaches and Improvement Models5.6.1 Analytical-Based Improvement with CMMI5.6.2 Analytical-Based Improvement with TPI NEXT5.6.3 Analytical-Based Improvement with TMMi5.6.4 Analytical-Based Improvement with CTP and STEP5.7 Exercises
6 Process for Improvement
6.1 Introduction6.1.1 IDEAL Process Improvement Framework6.1.2 Test Policy6.2 Initiating the Improvement Process6.2.1 Identify Stimulus for Change6.2.2 Set Objectives for Test Improvement6.2.3 Set Context6.2.4 Build Sponsorship6.2.5 Charter Infrastructure6.3 Diagnosing the Current Situation6.3.1 Planning the Assessment6.3.2 Assessment Preparation6.3.3 Performing Interviews6.3.4 Giving Feedback6.3.5 Analyzing Results6.3.6 Performing Solution Analysis6.3.7 Recommending Improvement Actions6.4 Establishing a Test Improvement Plan6.4.1 Set Priorities6.4.2 Develop an Implementation Approach6.4.3 Planning the Improvements6.5 Acting to Implement Improvement6.5.1 Selecting and Executing a Pilot6.5.2 Manage and Control the Implementation6.6 Learning from the Improvement Program6.7 Exercises
7 Organization, Roles, and Skills
7.1 Organization7.1.1 The Test Process Group (TPG)7.1.2 Test Improvement with Remote, Offshore, and Outsourced Teams7.2 Individual Roles and Staffing7.2.1 The Test Process Improver7.2.2 The Lead Assessor7.2.3 The Co-Assessor7.3 Skills of the Test Process Improver/Assessor7.3.1 Interviewing Skills7.3.2 Listening Skills7.3.3 Presentation and Reporting Skills7.3.4 Analytical Skills7.3.5 Note-Taking Skills7.3.6 Skills of Persuasion7.3.7 Management Skills7.3.8 Summary7.4 Exercises
8 Managing Change
8.1 Introduction8.2 Overview8.2.1 The Fundamental Change Process8.2.2 The Satir Model8.2.3 Tipping Points and Change8.3 Prepare for Change8.3.1 Establish the Need for Improvement8.3.2 Create a Sense of Urgency8.3.3 Establish the Improvement Team8.4 Decide What to Change8.4.1 Establish a Vision of the Future8.4.2 Set Specific Objectives and Align to Business Goals8.4.3 Decide on an Implementation Strategy8.4.4 Balance Short-Term and Longer-Term Benefits8.5 Making Change Happen8.5.1 Communicating for Buy-In and Understanding8.5.2 Anticipating Chaos8.5.3 Managing the Chaos8.5.4 Handling Resistance to Change8.5.5 Climbing Out of Chaos: Developing Transforming Ideas8.6 Making Change Stick8.6.1 Rollout of New Ideas and Practices8.6.2 Provide Lasting Support8.6.3 Create a New Culture of Improvement8.6.4 Practice Continuous Improvement Principles8.7 Data Privacy8.8 Exercises
9 Critical Success Factors
9.1 Critical Success Factors9.1.1 Getting Started9.1.2 Getting the Job Done9.1.3 Critical Success Factors: A Case Study9.2 Setting a Culture for Improvement9.2.1 Defining “Improvement Culture”9.2.2 Aspects of Improvement Culture9.2.3 Test Process Improvement Manifesto9.3 Exercises
10 Adapting to Different Life Cycle Models
10.1 Test Process Improvement with Different Life Cycles10.2 Exercises
Appendix A: Glossary
Appendix B: Literature and References
B.1 Books/JournalsB.2 ISTQB PublicationsB.3 StandardsB.4 Web References
Appendix C: The Syllabus Parts
Appendix D: The Exam
D.1 General Exam AspectsD.2 Part 1 Exam: “Assessing Test Processes”D.3 Part 2 Exam: “Implementing Test Process Improvement”D.4 TipsD.5 Common Problems
Appendix E: Summary of Cognitive Levels (K-Levels)
Appendix F: Answers
Index

Content preview from Improving the Test Process

Appendix E: Summary of Cognitive Levels (K-Levels)

A K-level, or cognitive level, is used to classify learning objectives according to the revised taxonomy from Bloom [Anderson and Krathwohl 2001]. ISTQB uses this taxonomy to design its syllabi examinations.

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Publisher Resources

ISBN: 9781492001300

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

Improving the Test Process

by Graham Bath, Erik Van Veenendaal

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.