Building a scraper with Selenium

First of all, we have to decide what kind of data we are going to scrape. In our case, the most interesting information are keyword-based search results which return a list of pins with their titles, descriptions, and usernames. We will try to see the users which are closest to each other in terms of similar interests. In order to start building the scraper we have to analyze the search results first.

We can see that the endpoint for the search is: https://www.pinterest.com/search/pins/. It already contains the search query under the q parameter.

Then, we can use Google Chrome or Mozilla Firefox inspector to ...

Get Python Social Media Analytics now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.