Tim Starling wrote:
The devs are usually pretty responsive, both to this list and (especially) the irc channel. Maybe they were all just away for the weekend, or something?
I'm busy moving back to Australia. I thought other people could probably handle this. I'll be largely unavailable until 19 September, approx 02:00 UTC.
I'm not aware of any evidence that the problem was fixed by switching bacon off, so it might be still ongoing. This needs to be monitored closely.
Ok, have a nice trip, I'll keep an eye on it. I can investigate it more closely when I'm free in 3-4 hours.
And in another post:
find -size 0 -print | xargs rm
It's a bit more complicated than that, since we're not using the images stored on bacon anymore. However they may be stored in the squid cluster. Something like...
find * -size 0 -print | perl -ne 'print "http://upload.wikimedia.org/$_%5Cn"' | php purgeList.php
That may work, or at least rule out the current hypothesis.
I have run a similar job last night. However that doesn't seem to totally fix it. Also users are reporting that even after purging and reappearing of thumbs, those thumbs often break again after a while.