Hands-On Web Scraping with Python

POST

These are known as secure requests that are made to a source. The requested resource state can be altered. Data that's posted or sent to the requested URL is not visible in the URL; instead, it's transferred to the request body. A request that's made using POST isn't cached or bookmarked and has no restrictions in terms of length.

In the following example, a simple HTTP request and response service (source: http://httpbin.org/) has been used to make a POST request.

pageUrl accepts data to be posted, as defined in params to postUrl. Custom headers are assigned as headers. The post() function from the requests library accepts URLs, data, and headers, and returns a response in JSON format:

import requestspageUrl="http://httpbin.org/forms/post" ...