O'Reilly logo

Python Requests Essentials by Bala Subrahmanyam Varanasi, Rakesh Vidya Chandra

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

What is web scraping?

In simple words, web scraping is the process of extracting desired data from a web resource. This method involves different procedures such as interacting with the web resource, choosing the appropriate data, obtaining information from the data, and converting the data to the desired format. With all the previous methods considered, a major spotlight will be thrown on the process of pulling the required data from the semistructured data.

Dos and don'ts of web scraping

Scraping a web resource is not always welcomed by the owners. Some companies put a restriction on using bots against them. It's etiquette to follow certain rules while scraping. The following are the dos and don'ts of web scraping:

  • Do refer to the terms and conditions ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required