[Toolserver-announce] Toolserver outage

[River Tarnell]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi,

There was an outage of the Toolserver from around 2200h, 17th August until 
around 0020h.  The initial cause of the outage was a network issue at Wikimedia 
(who provide us with transit).  The network outage caused a cascading failure 
of the two HA clusters (turnera/damiana and wolfsbane/ortelius), which 
prolonged the outage by about 20 minutes.

The problem is now resolved and all services should be accessible again.

Although the cluster outage did not significantly extend the outage (since 
cluster is quite good as recovering itself), it is nonetheless not something 
that should have happened, and we will be reviewing the cluster setup to 
prevent it happening in the future.

	- river..
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.16 (FreeBSD)

iEYEARECAAYFAkxrGiUACgkQIXd7fCuc5vLk5QCdGZPp2+5/kDUW3jq+NZ6HkVb0
hDsAn1GBCTY9n2v/idrjNXa08Zrnmol3
=D8KG
-----END PGP SIGNATURE-----