[Toolserver-announce] Unscheduled downtime, Wed 16th

[River Tarnell]

hi,

we had an outage of ~5 hours affecting all login servers from 04:15 UTC
to around 09:30 UTC.  the issue was fixed fairly quickly once noticed,
but it took some time for an admin to be contacted.

the outage was caused by a misconfiguration on the cluster which
prevented switching the NFS service from a failed node to a working one.
the misconfiguration has been fixed, so failover should work correctly
in the future.  (this was our first unscheduled cluster failover, so it
hadn't been tested before.)

a full description of the outage is available in MNT-56.

	- river.