Setting up a project

We will require a Python library with scrapy successfully installed on the system before proceeding with the project setup. For setting up or installation refer to Chapter 2, Python and the Web – Using urllib and Requests, Setting things up section or, for more details on Scrapy installation, please refer to the official installation guide at https://docs.scrapy.org/en/latest/intro/overview.html.

Upon successful installation, we can obtain the details shown in the following screenshot, using Python IDE:

Successful installation of Scrapy with details

With the successful installation of the scrapy library, there's also ...

Get Hands-On Web Scraping with Python now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.