might Google also be following "pages that link here", "random" and
"history"?
Wikipedia freezes almost every day around 3pm UK time, which is odd as
it's during the pediod with the fewest edits. Could that be when google
comes a-crawling?
we had problems on UnrealWiki with downloading robots calling too many
diff links & oveerloading the server.
tarquin
Joao Mário Miranda wrote: