Google Hacks

Scraping Google AdWords

Scrape the AdWords from a saved Google results page into a form suitable for importing into a spreadsheet or database.

Google’s AdWords™—the text ads that appear to the right of the regular search results—are delivered on a cost-per-click basis, and purchasers of the AdWords are allowed to set a ceiling on the amount of money they spend on their ad. This means if even if you run a search for the same query word multiple times, you won’t necessarily get the same set of ads each time.

If you’re considering using Google AdWords to run ads, you might want to gather up and save the ads that are running for the query words you’re interested in. Google AdWords are not provided by the Google API; of course you can’t automatically scrape Google’s results outside the Google API, because it’s against Google’s Terms of Service.

This hack will let you scrape the AdWords from a saved Google results page and export them to a CSV (comma-separated value) file, which you can then import into Excel or your favorite spreadsheet program.

Tip

This hack requires an additional Perl module, HTML::TokeParser (http://search.cpan.org/search?query=htmL%3A%3Atokeparser&mode=all). You’ll need to install it before the hack will run.

The Code

#!/usr/bin/perl # usage: perl adwords.pl results.html use strict; use HTML::TokeParser; die "I need at least one file: $!\n" unless @ARGV; my @Ads; for my $file (@ARGV){ # skip if the file doesn't exist # you could add more file testing here. # errors ...