O'Reilly logo

Webbots, Spiders, and Screen Scrapers by Michael Schrenk

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Further Exploration

Here are some other ways to leverage the techniques you learned in this chapter.

  • Design another search-ranking webbot to examine the paid advertising listings instead of the organic listings.

  • Write a similar webbot to run daily over a period of many days to measure how changing a web page's meta tags or content affects the page's search engine ranking.

  • Design a webbot that examines web page rankings using a variety of search terms.

  • Use the techniques explained in this chapter to examine how search rankings differ from search engine to search engine.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required