Python Machine Learning Blueprints - Second Edition

Parsing the DOM to extract pricing data

The DOM is the collection of elements that comprise a web page. It includes HTML tags such as body and div, as well as the classes and IDs embedded within these tags.

Let's take a look at the DOM for our Google page:

1. To see it, right-click on the page and click on Inspect. This should be the same for Firefox or Chrome. This will open the developer tab that allows you to see the page source information, as demonstrated in the following screenshot:

2. Once this is open, choose the element selector in the upper left-hand corner, and click on an element to jump to that element in the page source code: ...