O'Reilly logo

Practical Web Scraping for Data Science: Best Practices and Examples with Python by Bart Baesens, Seppe vanden Broucke

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

© Seppe vanden Broucke and Bart Baesens 2018

Seppe vanden Broucke and Bart Baesens, Practical Web Scraping for Data Science, https://doi.org/10.1007/978-1-4842-3582-9_6

6. From Web Scraping to Web Crawling

Seppe vanden Broucke and Bart Baesens2

(1)KU Leuven, Leuven, Belgium

(2)Dept of Decision Sci & Info Managem, KU Leuven Dept of Decision Sci & Info Managem, Leuven, Belgium

So far, the examples in the book have been quite simple in the sense that we only scraped (mostly) a single page. When writing web scrapers, however, there are many occasions where you’ll wish to scrape multiple pages and even multiple websites. In this context, the name “web crawler” is oftentimes used, as it will “crawl” across a site or even the complete web. This chapter ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required