Learn Python by Building Data Science Applications

Step 2 – Scraping information from the Wiki page

As we need to start from something, let's pick a battle page to test our code on – Operation Skorpion (en.wikipedia.org//wiki/Operation_Skorpion). The following is a screenshot of the page, with the areas in which we're interested highlighted in red:

The code for this part of the chapter is stored in the B_Scraping_part_2 notebook.

First, we can use the function we wrote in the earlier section to collect the page as a dom object:

url = 'https://en.wikipedia.org/wiki/Opeation_Scorpion'dom = get_dom(url)

Next, as in the previous case, we select the larger container that stores all the information ...