EuroPython project

In this section, we are going to build a project with Scrapy that allows us to extract the data of the sessions of the EuroPython conference following the pattern from the following URL: http://ep{year}.europython.eu/en/events/sessions. You can try with years from 2015 to 2018: for example we can try with the following URL: https://ep2018.europython.eu/events/sessions/.

To create a project with scrapy, we can execute the following command:

scrapy startproject europython

In this screenshot, we can see the result of creating a Scrapy project:

items.py is where we define the fields and the information that we are going to extract: ...

Get Learning Python Networking - Second Edition now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.