Mastering Python for Networking and Security

Introduction to the builtwith module

The type of technology used to build a website will affect the way you track it. To identify this information, you can make use of tools such as Wappalyzer and Builtwith (https://builtwith.com). A useful tool to verify the type of technologies a website is built with the module is builtWith, which can be installed with:

pip install builtwith

This module has a method called parse, which is passed by the URL parameter and returns as a response the technologies used by the website. Here is an example:

>>> import builtwith>>> builtwith.parse('http://example.webscraping.com'){u'javascript-frameworks': [u'jQuery', u'Modernizr', u'jQuery UI'],u'programming-languages': [u'Python'],u'web-frameworks': [u'Web2py', ...