--- Brion Vibber brion@pobox.com wrote:
Brion Vibber wrote:
PowerMedium had some sort of network and/or power outage for about an hour from circa 19:20 UTC. We've been working on getting things back online since power and network became available again.
Will post more about cause when we know more.
Apparently an 800-amp breaker in the main PDU failed.
The database servers are currently starting up; this takes a little while, but hopefully should be all done within the hour.
I thought each db server was on a UPS? If not, then why not? I also thought we had the capability to go read only from the other server farms when the Tampa farm went down. If not, then why not?
We are a top 20 website that makes more than enough money to hire enough people to make sure services decay gracefully and to make sure we have adequate redundancy. I'm working on the current year budget. Please start thinking about your staffing and equipment needs for the rest of the year.
-- mav
__________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com