October 2009
Beginner
350 pages
11h 10m
English
Content preview from Beautiful TestingBecome an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Chapter 22. Testing One Million Web Pages
Beauty is seeing disparate and rough test tools come together at the right time to create a special testing capability. In this chapter’s case, the test tools were originally developed six years ago when the Mozilla Project (where I am director of quality assurance) was a very different organization. These tools morphed from simple web spidering[106] tools to assertion and crash testers for a hundred web pages to an automated framework for testing one million web pages!
The resultant combined framework was needed to test a huge number of web pages in a very flexible way. This included testing on different operating systems, on different build types (e.g., standard and debug), across hangs and crashes, with highly selectable page sets.
It took the work of multiple people to innovate and collaborate to create interesting new tools along the way. These people built up tools, one upon another. The result was an amazing framework that can collect the top websites into sets. These can be 100 pages, 10,000 pages, or a million-plus pages. They can be the top pages across the world or the top shopping sites in Albania. And they can be tested using standard, debug, or optimized builds. The framework can test any combination of these that your mind can imagine or your test farm can handle.
What follows is the story of how the tools were refactored and morphed to test one million web pages.
In the Beginning…
…our small Mozilla Project team needed ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.