Python Web Scraping Cookbook

How to do it

We proceed with the recipe as follows:

1. The code for the recipe is in the 11/03/search_jobs_by_skills.py file:

from sojobs.scraping import get_job_listing_infofrom elasticsearch import Elasticsearchimport jsonif __name__ == "__main__":    es = Elasticsearch()    job_ids = ["122517", "163854", "138222", "164641"]    for job_id in job_ids:        if not es.exists(index='joblistings', doc_type='job-listing', id=job_id):            listing = get_job_listing_info(job_id)            es.index(index='joblistings', doc_type='job-listing', id=job_id, body=listing)    search_definition = {        "query": {            "match": {                "JSON.skills": {                    "query": "c#"                }            }        }    }    result = es.search(index="joblistings", doc_type="job-listing", body=search_definition)    print(json.dumps(result, indent=4))

The ...