[Toolserver-announce] Power outage

River Tarnell river.tarnell at wikimedia.de
Tue Jun 29 23:53:58 UTC 2010


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi,

At about 22:30 UTC last night (Tuesday) one of our power circuits went
down for about 15 minutes.  This affected one node of the HA cluster
which was hosting the following services:

	Sun Grid Engine master server
	tsbot IRC bot
	DNS recursor
	MySQL server for sql-toolserver
	MySQL replication support infrastructure
	LDAP server

All services failed over to the other node and were online again within
22 seconds.  However, MySQL did not respond well to losing its
replication connection and had to be restarted manually, causing about
30 minutes replication lag.

	- river.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.15 (FreeBSD)

iEYEARECAAYFAkwqh5YACgkQIXd7fCuc5vKQTwCgm1RTRwqQcaSpg7M4IL7brHGi
ZF0An0EuetoI6PyQ9/1KYwBIAoym+Ta6
=omgy
-----END PGP SIGNATURE-----



More information about the Toolserver-announce mailing list