-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
Hi,
There was an outage of the Toolserver from around 2200h, 17th August until around 0020h. The initial cause of the outage was a network issue at Wikimedia (who provide us with transit). The network outage caused a cascading failure of the two HA clusters (turnera/damiana and wolfsbane/ortelius), which prolonged the outage by about 20 minutes.
The problem is now resolved and all services should be accessible again.
Although the cluster outage did not significantly extend the outage (since cluster is quite good as recovering itself), it is nonetheless not something that should have happened, and we will be reviewing the cluster setup to prevent it happening in the future.
- river..
toolserver-announce@lists.wikimedia.org