Python Penetration Testing Cookbook

How to do it...

We can parse HTML tables from the downloaded pages as following:

1. As usual, we have to import the required modules for the script. Here, we import BeautifulSoup for parsing HTML and pandas for handling the data that is parsed. Also, we have to import the urllib module for getting the web page from the server:

import urllib2 
import pandas as pd 
from bs4 import BeautifulSoup 

2. Now we can get the HTML page from the server; for this, we can use the urllib module:

url = "https://www.w3schools.com/html/html_tables.asp" 
try: 
    page = urllib2.urlopen(url) 
except Exception as e: 
    print e 
    pass 

3. Then, we can use BeautifulSoup to parse the HTML and get the table from it:

soup = BeautifulSoup(page, "html.parser") table = soup.find_all('table')[0] ...