[Labs-announce] Labs NFS outage just concluded

Andrew Bogott abogott at wikimedia.org
Sun Jun 7 05:31:56 UTC 2015


We're just coming out of an approximately 4-hour NFS outage.  The outage 
was at least partially caused by errors on the network switch.  That 
issue is resolved, but there may be a second issue (possibly caused by a 
badly-behaved client) waiting to strike again.

Here's the outage report so far, still sketchy on details and action items:

https://wikitech.wikimedia.org/wiki/Incident_documentation/20150607-LabsNFS-Outage

I'm sure that Yuvi and Coren will followup here with any needed 
instructions to get your tools back online.

-Andrew




More information about the Labs-announce mailing list