Under the Options tab, a tester has the following options:
- Crawler Settings: It provides the ability to regulate the number of links deep Spider will follow; also identifies basic web content to Spider for on a website such as the robots.txt file:
- Passive Spidering: Spiders newly-discovered content in the background and is turned on by default:
- Form Submission: It provides the ability to determine how Spider interacts with forms. Several options are available including ignore, prompt for guidance, submit with default values ...