[webkit-dev] Pages from the wiki vanished from google search results
wsiegrist at apple.com
Sun Jun 5 20:46:23 PDT 2011
On Jun 5, 2011, at 7:20 PM, Matt Falkenhagen wrote:
> I had noticed this too and asked about it internally. It turns out
> webkit.org was (is?) returning 403 errors to googlebot. This caused
> the pages to be lost. However, it is still returning content on
> https:// addresses, so those are now starting to be picked up as you
> can now see in the Google searches above.
Googlebot was apparently blacklisted at some point for hitting the servers too hard. I removed them, they should not get 403s anymore.
More information about the webkit-dev