<html>
<head>
<style><!--
.hmmessage P
{
margin:0px;
padding:0px
}
body.hmmessage
{
font-size: 12pt;
font-family:Calibri
}
--></style></head>
<body class='hmmessage'><div dir='ltr'>Hello,<br><br>There where a lot of outages/problems wit tools in the last months.<br><br>What the Foundation (Tech department) plans to do to prevent such outages/problems?<br><br>Regards,<br><br><div>> Date: Fri, 19 Jun 2015 02:32:04 -0400<br>> From: marc@uberbox.org<br>> To: labs-l@lists.wikimedia.org<br>> Subject: [Labs-l] [NFS outage] Tools is back<br>> <br>> Hey all,<br>> <br>> The tools project is/should be back up now, with three important caveats:<br>> <br>> * All the files on NFS (in /home and /data/project) have been<br>> reverted to their version as of Jun 8 2015 around 14h UTC[1].<br>> * Any crontabs your tools may have have been commented out to<br>> avoid the risk of invoking obsolete/broken code until you<br>> have had an opportunity to update or fix it.<br>> <br>> Otherwise, and as far as I know, we are now back to fully operational<br>> status. It's possible that some bugs may shake out in the coming days,<br>> don't hesitate to poke a labs admin if that is the case.<br>> <br>> -- Marc<br>> <br>> [1] work to salvage as much of the crashed filesystem as possible<br>> continues, but may not have good success. In any case, we will<br>> *not* restore that version; but if you have precious data<br>> or files dating after Jun 8 which you absolutely cannot<br>> recover otherwise, we /may/ be able to recover them for you.<br>> <br>> _______________________________________________<br>> Labs-l mailing list<br>> Labs-l@lists.wikimedia.org<br>> https://lists.wikimedia.org/mailman/listinfo/labs-l<br></div> </div></body>
</html>