Skip to Content
Beautiful Testing
book

Beautiful Testing

by Adam Goucher, Tim Riley
October 2009
Beginner
350 pages
11h 10m
English
O'Reilly Media, Inc.
Content preview from Beautiful Testing

Case Study of the OpenSolaris Desktop Team

The desktop QA team is responsible for the quality of all the desktop applications included with OpenSolaris. These applications include open source projects from many communities, including GNOME, Mozilla, Compiz, Pidgin, etc. OpenSolaris is on a six-month release schedule, but a development build is released to the community every two weeks. Due to the frequency of releases and to ensure high quality, the desktop QA team adopted a formal test process with a focus on functional testing. The QA team was responsible for the test plan and the design of test cases. Many of the test cases come from open source communities. For example, most of the test cases for Firefox are from the Mozilla community, which uses a test case management tool called Litmus.

For most of the desktop applications, although 100% of the test cases are executed, there are still bugs filed out of the normal QA test cycle. The QA team tracks the TCE trend at every build in order to measure and improve the effectiveness of the test cases over the course of development of an OpenSolaris release. The following sections outline an example of how to measure and improve the test cases’ effectiveness.

Assumptions

For the OpenSolaris desktop project, we classify all bugs submitted by non-QA engineers as test escapes, excluding the following:

  • Enhancement

  • Localization (L10N) OS-related

  • Hardware

  • Device drivers

  • Globalization (G11N)

  • Build

  • “Cannot reproduce”

  • “Not a bug”

  • Duplicates

The Process of ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

Effective Software Testing

Effective Software Testing

Mauricio Aniche
Tidy First?

Tidy First?

Kent Beck

Publisher Resources

ISBN: 9780596806934Catalog PageErrata