All About Content

You Can Hide from Googlebot…

Posted by Melanie Phung on Sunday, April 30, 2006 at 12:24 am

… but you can’t hide from Google’s bots. Google has confirmed that it’s using multiple spiders to feed crawl results into Bigdaddy. Specifically mentioned is that the AdSense mediapartners bot (a.k.a. mediabot) is caching pages for the natural search index.

Jenstar points out:

It could definitely be used as a tool to detect when content is being cloaked for either the Google or AdSense bot, particularly since the mediapartners bot has been indexing pages since at least the beginning of February.

Who knows how many other-named spiders Google has doing recon like this. Definitely would make the old IP cloaking black hat trick a little trickier.

More info on the crawl caching proxy on Matt Cutts’s site.

Comments Off on You Can Hide from Googlebot…

Category: Cloaking,Googlebot

No Comments

No comments yet.

Sorry, the comment form is closed at this time.