This book identifies the limitations of typical web browsers and explores how you can use webbots to capitalize on these limitations. You'll learn how to design and write webbots through sample scripts and example projects. Moreover, you'll find answers to larger design questions like these:
Where do ideas for webbot projects come from?
How can I have fun with webbots and stay out of trouble?
Is it possible to write stealthy webbots that run without detection?
What is the trick to writing robust, fault-tolerant webbots that won't break as Internet content changes?
I've written webbots, spiders, and screen scrapers for nearly 10 years, and in the process I've made most of the mistakes someone can make. ...