Python Penetration Testing Cookbook

How to do it...

We use custom user agent string in the request as following:

1. First, import the required modules:

>>> import urllib.request  

2. Then define the user agent we plan to specify for the request:

>>> user_agent = ' Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:47.0) Gecko/20100101 Firefox/47.0'  

3. Set up the headers for the request:

>>> headers = {'User-Agent': user_agent}  

4. Create the request as follows:

>>> request = urllib.request.Request("https://www.packtpub.com/", headers=headers)  

5. Request the web page with urlopen:

>>> with urllib.request.urlopen(request) as response:
...     with open('with_new_user_agent.html', 'wb') as out:
...         out.write(response.read())