book

Advanced Software Testing - Vol. 3, 2nd Edition, 2nd Edition

by Jamie L Mitchell, Rex Black

March 2015

Intermediate to advanced

480 pages

11h 50m

English

Rocky Nook

Read now

Unlock full access

Cover Page
Title Page
Copyright Page
Table of Contents
Jamie Mitchell’s Acknowledgements
Rex Black’s Acknowledgements
Introduction
1 The Technical Test Analyst’s Tasks in Risk-Based Testing
1.1 Introduction1.2 Risk Identification1.3 Risk Assessment1.4 Risk Mitigation or Risk Control1.5 An Example of Risk Identification and Assessment Results1.6 Risk-Aware Testing Standard1.7 Sample Exam Questions
2 Structure-Based Testing
2.1 Introduction2.1.1 Control Flow Testing Theory2.1.2 Building Control Flow Graphs2.1.3 Statement Coverage2.1.4 Decision Coverage2.1.5 Loop Coverage2.1.6 Hexadecimal Converter Exercise2.1.7 Hexadecimal Converter Exercise Debrief2.2 Condition Coverage2.3 Decision Condition Coverage2.4 Modified Condition/Decision Coverage (MC/DC)2.4.1 Complicating Issues: Short-Circuiting2.4.2 Complicating Issues: Coupling2.5 Multiple Condition Coverage2.5.1 Control Flow Exercise2.5.2 Control Flow Exercise Debrief1. Determine the tests required for decision condition coverage.2. Determine the total number of tests required to achieve MC/DC coverage (assuming no short-circuiting) and define them.3. Determine the total number of tests needed for multiple condition coverage.4. If the compiler is set to short-circuit, which of those tests are actually needed?2.6 Path Testing2.6.1 Path Testing via Flow Graphs2.6.2 Basis Path Testing2.6.3 Cyclomatic Complexity Exercise2.6.4 Cyclomatic Complexity Exercise Debrief2.7 API Testing2.8 Selecting a Structure-Based TechniqueStructure-Based Testing Exercise2.8.1 Structure-Based Testing Exercise Debrief1. How many test cases are needed for basis path coverage?2. If we wanted to test this module to the level of multiple condition coverage (ignoring the possibility of short-circuiting), how many test cases would we need?3. If this code were in a system that was subject to FAA/DO178C and was rated at Level A criticality, how many test cases would be needed for the first if() statement alone?4. To achieve only statement coverage, how many test cases would be needed?2.9 A Final Word on Structural Testing2.10 Sample Exam Questions
3 Analytical Techniques
3.1 Introduction3.2 Static Analysis3.2.1 Control Flow Analysis3.2.2 Data Flow Analysis3.2.2.1 Define-Use Pairs3.2.2.2 Define-Use Pair Example3.2.2.3 Data Flow Exercise3.2.2.4 Data Flow Exercise Debrief3.2.2.5 A Data Flow Strategy3.2.3 Static Analysis to Improve Maintainability3.2.3.1 Code Parsing Tools3.2.3.2 Standards and Guidelines3.2.4 Call Graphs3.2.4.1 Call-Graph-Based Integration Testing3.2.4.2 McCabe’s Design Predicate Approach to Integration3.2.4.3 Hex Converter Example3.2.4.4 McCabe Design Predicate Exercise3.2.4.5 McCabe Design Predicate Exercise Debrief3.3 Dynamic Analysis3.3.1 Memory Leak Detection3.3.2 Wild Pointer Detection3.3.3 Dynamic Analysis Exercise3.3.4 Dynamic Analysis Exercise Debrief3.4 Sample Exam Questions

4 Quality Characteristics for Technical Testing
4.1 Introduction4.2 Security Testing4.2.1 Security Issues4.2.1.1 Piracy4.2.1.2 Buffer Overflow4.2.1.3 Denial of Service4.2.1.4 Data Transfer Interception4.2.1.5 Breaking Encryption4.2.1.6 Logic Bombs/Viruses/Worms4.2.1.7 Cross-Site Scripting4.2.1.8 Timely Information4.2.1.9 Internal Security Metrics4.2.1.10 External Security Metrics4.2.1.11 Exercise: Security4.2.1.12 Exercise: Security Debrief4.3 Reliability Testing4.3.1 Maturity4.3.1.1 Internal Maturity Metrics4.3.1.2 External Maturity Metrics4.3.2 Fault Tolerance4.3.2.1 Internal Fault Tolerance Metrics4.3.2.2 External Fault Tolerance Metrics4.3.3 Recoverability4.3.3.1 Internal Recoverability Metrics4.3.3.2 External Recoverability Metrics4.3.4 Compliance4.3.4.1 Internal Compliance Metrics4.3.4.2 External Compliance Metrics4.3.5 An Example of Good Reliability Testing4.3.6 Exercise: Reliability Testing4.3.7 Exercise: Reliability Testing Debrief4.4 Efficiency Testing4.4.1 Multiple Flavors of Efficiency Testing4.4.2 Modeling the System4.4.2.1 Identify the Test Environment4.4.2.2 Identify the Performance Acceptance Criteria4.4.2.3 Plan and Design Tests4.4.2.4 Configure the Test Environment4.4.2.5 Implement the Test Design4.4.2.6 Execute the Test4.4.2.7 Analyze the Results, Tune and Retest4.4.3 Time Behavior4.4.3.1 Internal Time Behavior Metrics4.4.3.2 External Time Behavior Metrics4.4.4 Resource Utilization4.4.4.1 Internal Resource Utilization Metrics4.4.4.2 External Resource Utilization Metrics4.4.5 Compliance4.4.5.1 Internal Compliance Metric4.4.5.2 External Compliance Metric4.4.6 Exercise: Efficiency Testing4.4.7 Exercise: Efficiency Testing Debrief4.5 Maintainability Testing4.5.1 Analyzability4.5.1.1 Internal Analyzability Metrics4.5.1.2 External Analyzability Metrics4.5.2 Changeability4.5.2.1 Internal Changeability Metrics4.5.2.2 External Changeability Metrics4.5.3 Stability4.5.3.1 Internal Stability Metrics4.5.3.2 External Stability Metrics4.5.4 Testability4.5.4.1 Internal Testability Metrics4.5.4.2 External Testability Metrics4.5.5 Compliance4.5.5.1 Internal Compliance Metric4.5.5.2 External Compliance Metric4.5.6 Exercise: Maintainability Testing4.5.7 Exercise: Maintainability Testing Debrief4.6 Portability Testing4.6.1 Adaptability4.6.1.1 Internal Adaptability Metrics4.6.1.2 External Adaptability Metrics4.6.2 Replaceability4.6.2.1 Internal Replaceability Metrics4.6.2.2 External Replaceability Metrics4.6.3 Installability4.6.3.1 Internal Installability Metrics4.6.3.2 External Installability Metrics4.6.4 Coexistence4.6.4.1 Internal Coexistence Metrics4.6.4.2 External Coexistence Metrics4.6.5 Compliance4.6.5.1 Internal Compliance Metrics4.6.5.2 External Compliance Metrics4.6.6 Exercise: Portability Testing4.6.7 Exercise: Portability Testing Debrief4.7 General Planning Issues4.8 Sample Exam Questions
5 Reviews
5.1 Introduction5.2 Using Checklists in Reviews5.2.1 Some General Checklist Items for Design and Architecture Reviews5.2.2 Deutsch’s Design Review Checklist5.2.3 Some General Checklist Items for Code Reviews5.2.4 Marick’s Code Review Checklist5.2.5 The Open Laszlo Code Review Checklist5.3 Deutsch Checklist Review Exercise5.4 Deutsch Checklist Review Exercise Debrief5.5 Code Review Exercise5.6 Code Review Exercise Debrief5.7 Sample Exam Questions
6 Test Tools and Automation
6.1 Integration and Information Interchange between Tools6.2 Defining the Test Automation Project6.2.1 Preparing for a Test Automation Project6.2.2 Why Automation Projects Fail6.2.3 Automation Architectures (Data Driven vs. Keyword Driven)6.2.3.1 The Capture/Replay Architecture6.2.3.2 Evolving from Capture/Replay6.2.3.3 The Simple Framework Architecture6.2.3.4 The Data-Driven Architecture6.2.3.5 The Keyword-Driven Architecture6.2.4 Creating Keyword-Driven Tables6.2.4.1 Building an Intelligent Front End6.2.4.2 Keywords and the Virtual Machine6.2.4.3 Benefits of the Keyword Architecture6.2.4.4 Creating Keyword-Driven Tables Exercise6.2.4.5 Keyword-Driven Exercise Debrief6.3 Specific Test Tools6.3.1 Fault Seeding and Fault Injection Tools6.3.2 Performance Testing and Monitoring Tools6.3.2.1 Data for Performance Testing6.3.2.2 Building Scripts6.3.2.3 Measurement Tools6.3.2.4 Performing the Testing6.3.2.5 Performance Testing Exercise6.3.2.6 Performance Testing Exercise Debrief6.3.3 Tools for Web Testing6.3.4 Model-Based Testing Tools6.3.5 Tools to Support Component Testing and Build Process6.4 Sample Exam Questions
7 Preparing for the Exam
Learning Objectives
Appendix
Bibliography
Advanced Syllabus Referenced StandardsAdvanced Syllabus Referenced BooksAdvanced Syllabus Other ReferencesOther Referenced BooksOther ReferencesReferenced Standards
HELLOCARMS The Next Generation of Home Equity Lending
I Table of ContentsII VersioningIII Glossary000 Introduction001 Informal Use Case003 Scope004 System Business Benefits010 Functional System Requirements020 Reliability System Requirements030 Usability System Requirements040 Efficiency System Requirements050 Maintainability System Requirements060 Portability System RequirementsA Acknowledgement
Answers to Sample Questions
Footnotes
1 The Technical Test Analyst’s Tasks in Risk-Based Testing2 Structure-Based Testing3 Analytical Techniques4 Quality Characteristics for Technical Testing5 Reviews6 Test Tools and Automation

Overview

This book is written for the technical test analyst who wants to achieve advanced skills in test analysis, design, and execution. With a hands-on, exercise-rich approach, this book teaches you how to define and carry out the tasks required to implement a test strategy. You will be able to analyze, design, implement, and execute tests using risk considerations to determine the appropriate effort and priority for tests.

This book will help you prepare for the ISTQB Advanced Technical Test Analyst exam. Included are sample exam questions for most of the learning objectives covered by the latest (2012) ISTQB Advanced Level syllabus. The ISTQB certification program is the leading software tester certification program in the world. You can be confident in the value and international stature that the Advanced Technical Test Analyst certificate will offer you.

With over thirty years of software and systems engineering experience, author Rex Black is President of RBCS, a leader in software, hardware, and systems testing, and the most prolific author practicing in the field of software testing today. Previously, he served as President of both the International and American Software Testing Qualifications Boards (ISTQB and ASTQB).

Jamie Mitchell is a consultant who has been working in software testing, test automation, and development for over 20 years. He was a member of the Technical Advisory Group for ASTQB, and one of the primary authors for the ISTQB Advanced Technical Test Analyst 2012 syllabus.

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Advanced Software Testing - Vol. 2, 2nd Edition, 2nd Edition

Publisher Resources

ISBN: 9781457189074

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills