Comments on: SERP Scraping for Fun and Profit Case Study: Facebook

By: Gary

Gary — Thu, 07 Apr 2011 11:22:31 +0000

Dan you’re a legend. I’m sure I tried that but probably messed about with the script too much. After downloading the script once more and simply using the above line as example (stupid me). It worked a treat.

Thanks again for sharing this.

By: Yousaf Sekander

Yousaf Sekander — Tue, 05 Apr 2011 08:31:22 +0000

Hi Gary,

You are getting the syntax wrong i.e. you got unescaped quote -> “Community

By: WordPress Doctors

WordPress Doctors — Tue, 05 Apr 2011 08:29:44 +0000

Hi Gary

Where you have:
$query = urlencode(ENTER QUERY HERE);

“ENTER QUERY HERE” should be a normal Google Query. e.g. site:example.com test

Having the % and +, etc will definitely break the script, since urlencode() is designed to put those characters into the string for you. By putting in the % and + yourself, urlencode() will completely break that query.

So just put a normal human-readable query into “ENTER QUERY HERE”, and try again.

Kind Regards
Dan
(one of the devs who worked on the above script).

By: Gary

Gary — Mon, 04 Apr 2011 06:17:38 +0000

Any thoughts on that script Rishal?

Many thanks
Gary

By: Reference.com has millions of junk pages in Google | Luke's blog

Reference.com has millions of junk pages in Google | Luke's blog — Fri, 01 Apr 2011 14:26:32 +0000

[...] another large name in the content business is utilising their authority get low-quality pages ranked and driving traffic. Search results in search results (or, [...]

By: Gary

Gary — Fri, 01 Apr 2011 11:40:03 +0000

This is what I’ve changed

FROM:
$query = urlencode(ENTER QUERY HERE);

TO:
$query = urlencode(”site%3Afacebook.com%2F+”Community+Pages+are+not+affiliated+with%2C+or+endorsed+by%2C+anyone+associated+with+the+topic”);

Haven’t changed anything else in the script. My csv file just gets

title URL description in 1 column

Thanks for your help

Just added your RSS feed to my reader, useful blog

By: rishil

rishil — Fri, 01 Apr 2011 10:39:27 +0000

Have you tried both? If so, hit up the debs I linked to, sure they will help…

By: Gary

Gary — Fri, 01 Apr 2011 10:31:01 +0000

Great article and thanks for sharing. I’m tryiing your script and can’t seem to get it working.

I’ve changed the $query = urlencode(”site%with search query here”);

I get empty results

Any help much appreciated

Thanks

By: andymurd

andymurd — Fri, 01 Apr 2011 03:09:03 +0000

Nice one, Rishi. And special thanks for maling the scripts and spreadsheet available – the data shows just how little Face book care about the quality of content on their site.

Now can you figure out how to scrape Google Insights for Search, please?

By: Jey Pandian

Jey Pandian — Thu, 31 Mar 2011 18:14:17 +0000

Amen. I’ve hella been enjoying your articles of late too. Definitely a value add and prioritized in my list of emails to read.