Mastering Python Scripting for System Administrators

The urllib package

Like http, urllib is also a package that has various modules for working with URLs. The urllib module allows you to access several websites via your script. We can also download data, parse data, modify headers, and more using this module.

urllib has a few different modules, which are listed here:

• urllib.request: This is used for opening and reading URLs.
• urllib.error: This contains exceptions raised by urllib.request.
• urllib.parse: This is used for parsing URLs.
• urllib.robotparser: This is used for parsing robots.txt files.

In this section, we are going to learn about opening a URL using urllib and how to read html files from the URL. We are going to see a simple example of the use of urllib. We will import urllib.requests ...