It appears that we were actually taken down by the reddit community, after a link to the fundraising stats page was posted under Brandon's IAMA there.
sq71.wikimedia.org 943326197 2011-11-27T22:51:09.075 62032 109.125.42.71 TCP_MISS/200 1035 GET http://wikimediafoundation.org/wiki/Special:FundraiserStatistics ANY_PARENT/ 208.80.152.47 text/html * http://www.reddit.com/r/IAmA/comments/mr4pf/i_am_wikipedia_programmer_brando... * - Mozilla/5.0%20(Windows%20NT%206.1;%20WOW64)%20AppleWebKit/535.2%20(KHTML,%20like%20Gecko)%20Chrome/15.0.874.121%20Safari/535.2
That page wasn't suitable for high volume public consumption (very expensive db query + not properly cached), so the site problem persisted even after the db initially suspected as bad was rotated out.
On Sun, Nov 27, 2011 at 2:39 PM, Erik Moeller erik@wikimedia.org wrote:
We had a site outage of about 30 mins, caused by a major issue, potentially hardware-related, with a database server, which blocked all MediaWiki application servers (and thereby rendered most of our sites unusable). Should be fixed now; we'll prepare a more comprehensive incident analysis soon.
Thanks to the ops team for their speedy response.
All best, Erik -- Erik Möller VP of Engineering and Product Development, Wikimedia Foundation
Support Free Knowledge: http://wikimediafoundation.org/wiki/Donate
Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l