... but you can't hide from Google's bots. Google has confirmed that it's using multiple spiders to feed crawl results into Bigdaddy. Specifically mentioned is that the AdSense mediapartners bot (a.k.a. mediabot) is caching pages for the natural search index.
Jenstar points out:
It could definitely be used as a tool to detect when content is being cloaked for either the Google or AdSense bot, particularly since the mediapartners bot has been indexing pages since at least the beginning of February.
Who knows how many other-named spiders Google has doing recon like this. Definitely would make the old
IP cloaking black hat trick a little trickier.
More info on the
crawl caching proxy on Matt Cutts's site.
Labels: cloaking, googlebot
Posted by Melanie Phung
Get RSS feed
You Can Hide from Googlebot...
... but you can't hide from Google's bots. Google has confirmed that it's using multiple spiders to feed crawl results into Bigdaddy. Specifically mentioned is that the AdSense mediapartners bot (a.k.a. mediabot) is caching pages for the natural search index.
Who knows how many other-named spiders Google has doing recon like this. Definitely would make the old IP cloaking black hat trick a little trickier.Jenstar points out:
More info on the crawl caching proxy on Matt Cutts's site.
Labels: cloaking, googlebot
Posted by Melanie Phung