<html><head><meta http-equiv="Content-Type" content="text/html charset=iso-8859-1"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Any ETA when I can SSH back in and restore my bots?<div class=""><br class=""></div><div class=""><div class="">
<div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Cyberpower678<br class="">English Wikipedia Account Creation Team<br class="">Mailing List Moderator</div><div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><br class=""></div><br class="Apple-interchange-newline">
</div>
<br class=""><div style=""><blockquote type="cite" class=""><div class="">On Jun 18, 2015, at 09:48, Steinsplitter Wiki <<a href="mailto:steinsplitter-wiki@live.com" class="">steinsplitter-wiki@live.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">the foundation isn't able to provide a service that works in real life.<br class=""><br class=""><div class=""><hr id="stopSpelling" class="">From:<span class="Apple-converted-space"> </span><a href="mailto:maximilian.doerr@gmail.com" class="">maximilian.doerr@gmail.com</a><br class="">Date: Thu, 18 Jun 2015 09:47:07 -0400<br class="">To:<span class="Apple-converted-space"> </span><a href="mailto:labs-l@lists.wikimedia.org" class="">labs-l@lists.wikimedia.org</a><br class="">Subject: Re: [Labs-l] NFS outage in progress [UPDATE]<br class=""><br class="">Mist. Ich bekomme wieder beschwerte dass meine Bots schon wieder nicht funktionieren. :/<div class=""><br class=""><div class=""><div style="letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; word-wrap: break-word;" class="">Cyberpower678<br class="">English Wikipedia Account Creation Team<br class="">Mailing List Moderator</div><div style="letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; word-wrap: break-word;" class=""><br class=""></div><br class="ecxApple-interchange-newline"></div><br class=""><div class=""><blockquote class=""><div class="">On Jun 18, 2015, at 09:45, Steinsplitter Wiki <<a href="mailto:steinsplitter-wiki@live.com" class="">steinsplitter-wiki@live.com</a>> wrote:</div><br class="ecxApple-interchange-newline"><div class=""><div dir="ltr" style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px;" class="">>> Hat was hier los ist damit was zum tun?<span class="ecxApple-converted-space"> </span><br class=""><br class="">ja :(<br class=""><br class=""><div class=""><hr id="ecxstopSpelling" class="">From:<span class="ecxApple-converted-space"> </span><a href="mailto:maximilian.doerr@gmail.com" class="">maximilian.doerr@gmail.com</a><br class="">Date: Thu, 18 Jun 2015 09:41:53 -0400<br class="">To:<span class="ecxApple-converted-space"> </span><a href="mailto:labs-l@lists.wikimedia.org" class="">labs-l@lists.wikimedia.org</a><br class="">Subject: Re: [Labs-l] NFS outage in progress [UPDATE]<br class=""><br class="">Ich kann weder einloggen oder meine Bot Seiten aufrufen. Hat was hier los ist damit was zum tun? ACC funktioniert auch nicht.<div class=""><br class=""><div class=""><div style="letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; word-wrap: break-word;" class="">Cyberpower678<br class="">English Wikipedia Account Creation Team<br class="">Mailing List Moderator</div><div style="letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; word-wrap: break-word;" class=""><br class=""></div><br class="ecxApple-interchange-newline"></div><br class=""><div class=""><blockquote class=""><div class="">On Jun 18, 2015, at 09:40, Steinsplitter Wiki <<a href="mailto:steinsplitter-wiki@live.com" class="">steinsplitter-wiki@live.com</a>> wrote:</div><br class="ecxApple-interchange-newline"><div class=""><div dir="ltr" style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px;" class="">@<a class="ecxt_atc ecxICName" target="_blank">Martin Domdey</a>: hi, ist exakt das selbe was in der vorherigen mail zu finden ist, ich erwarte mir von seiten der foundation eine genauere antwort. z.B. noch zwei stunden<br class=""><br class="">um ehrlich zu sein dürfte so etwas nicht passieren, toolslab ist stark genutzt.<br class=""><br class=""><div class=""><hr id="ecxstopSpelling" class="">From:<span class="ecxApple-converted-space"> </span><a href="mailto:animalia@gmx.net" class="">animalia@gmx.net</a><br class="">To:<span class="ecxApple-converted-space"> </span><a href="mailto:labs-l@lists.wikimedia.org" class="">labs-l@lists.wikimedia.org</a><br class="">Date: Thu, 18 Jun 2015 15:08:15 +0200<br class="">Subject: Re: [Labs-l] NFS outage in progress [UPDATE]<br class=""><br class=""><div style="font-family: Verdana; font-size: 12px;" class=""><div class="">Hey Steini, soll noch mehrere Stunden dauern laut den Technikern ...<div class=""> <div style="padding: 10px 0px 10px 10px; border-left-width: 2px; border-left-style: solid; border-left-color: rgb(195, 217, 229); word-wrap: break-word;" class=""><div class=""><b class="">Gesendet:</b> Donnerstag, 18. Juni 2015 um 14:55 Uhr<br class=""><b class="">Von:</b> "Steinsplitter Wiki" <<a href="mailto:steinsplitter-wiki@live.com" class="">steinsplitter-wiki@live.com</a>><br class=""><b class="">An:</b> "Wikimedia Labs" <<a href="mailto:labs-l@lists.wikimedia.org" class="">labs-l@lists.wikimedia.org</a>><br class=""><b class="">Betreff:</b> Re: [Labs-l] NFS outage in progress [UPDATE]</div><div class=""><div class="ecxhmmessage"><div class="">Toolslabs will be back soon? When approximately?<br class=""> <div class="">> Date: Wed, 17 Jun 2015 23:09:11 -0400<br class="">> From:<span class="ecxApple-converted-space"> </span><a href="mailto:marc@uberbox.org" class="">marc@uberbox.org</a><br class="">> To:<span class="ecxApple-converted-space"> </span><a href="mailto:abogott@wikimedia.org" class="">abogott@wikimedia.org</a>;<span class="ecxApple-converted-space"> </span><a href="mailto:labs-l@lists.wikimedia.org" class="">labs-l@lists.wikimedia.org</a><br class="">> Subject: Re: [Labs-l] NFS outage in progress [UPDATE]<br class="">><br class="">> On 15-06-17 09:29 PM, Andrew Bogott wrote:<br class="">> > Coren is rebooting and fscking the system -- with luck it'll be up<br class="">> > again within the hour.<br class="">><br class="">> Fortune does not smile upon us; the fsck is taking a LONG time to<br class="">> progress (over a 40T filesystem), but the repair goes apace.<br class="">><br class="">> There is already indication of some lost data - though the failures are<br class="">> likely to date from a past crash and may have gone unnoticed for some time.<br class="">><br class="">> Either way, we have a fairly recent (8-9 days) backup of the entire<br class="">> filesystem so we may be able to recover lost or corrupted files if any<br class="">> turn up.<br class="">><br class="">> Worst case scenario is a catastrophic loss of the entire filesystem<br class="">> (which does not seem likely at this time), in which case we will restore<br class="">> the filesystem completely from the backup.<br class="">><br class="">> The repair process will take at least a few more hours, during which I<br class="">> will be keeping watch. I will update this list as soon as I have a<br class="">> better assessment of the damage, if any.<br class="">><br class="">> -- Marc<br class="">><br class="">><br class="">> _______________________________________________<br class="">> Labs-l mailing list<br class="">><span class="ecxApple-converted-space"> </span><a href="mailto:Labs-l@lists.wikimedia.org" class="">Labs-l@lists.wikimedia.org</a><br class="">><span class="ecxApple-converted-space"> </span><a href="https://lists.wikimedia.org/mailman/listinfo/labs-l" target="_blank" class="">https://lists.wikimedia.org/mailman/listinfo/labs-l</a></div></div>_______________________________________________ Labs-l mailing list<span class="ecxApple-converted-space"> </span><a href="mailto:Labs-l@lists.wikimedia.org" class="">Labs-l@lists.wikimedia.org</a><span class="ecxApple-converted-space"> </span><a href="https://lists.wikimedia.org/mailman/listinfo/labs-l" target="_blank" class="">https://lists.wikimedia.org/mailman/listinfo/labs-l</a></div></div></div></div></div></div><br class="">_______________________________________________ Labs-l mailing list<span class="ecxApple-converted-space"> </span><a href="mailto:Labs-l@lists.wikimedia.org" class="">Labs-l@lists.wikimedia.org</a><span class="ecxApple-converted-space"> </span><a href="https://lists.wikimedia.org/mailman/listinfo/labs-l" target="_blank" class="">https://lists.wikimedia.org/mailman/listinfo/labs-l</a></div></div><span style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; display: inline !important;" class="">_______________________________________________</span><br style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px;" class=""><span style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; display: inline !important;" class="">Labs-l mailing list</span><br style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px;" class=""><a href="mailto:Labs-l@lists.wikimedia.org" style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px;" class="">Labs-l@lists.wikimedia.org</a><br style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px;" class=""><a href="https://lists.wikimedia.org/mailman/listinfo/labs-l" target="_blank" style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px;" class="">https://lists.wikimedia.org/mailman/listinfo/labs-l</a></div></blockquote></div><br class=""></div><br class="">_______________________________________________ Labs-l mailing list<span class="ecxApple-converted-space"> </span><a href="mailto:Labs-l@lists.wikimedia.org" class="">Labs-l@lists.wikimedia.org</a><span class="ecxApple-converted-space"> </span><a href="https://lists.wikimedia.org/mailman/listinfo/labs-l" target="_blank" class="">https://lists.wikimedia.org/mailman/listinfo/labs-l</a></div></div><span style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; display: inline !important;" class="">_______________________________________________</span><br style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px;" class=""><span style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; display: inline !important;" class="">Labs-l mailing list</span><br style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px;" class=""><a href="mailto:Labs-l@lists.wikimedia.org" style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px;" class="">Labs-l@lists.wikimedia.org</a><br style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px;" class=""><a href="https://lists.wikimedia.org/mailman/listinfo/labs-l" target="_blank" style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px;" class="">https://lists.wikimedia.org/mailman/listinfo/labs-l</a></div></blockquote></div><br class=""></div><br class="">_______________________________________________ Labs-l mailing list<span class="Apple-converted-space"> </span><a href="mailto:Labs-l@lists.wikimedia.org" class="">Labs-l@lists.wikimedia.org</a><span class="Apple-converted-space"> </span><a href="https://lists.wikimedia.org/mailman/listinfo/labs-l" class="">https://lists.wikimedia.org/mailman/listinfo/labs-l</a></div></div><span style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">_______________________________________________</span><br style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Labs-l mailing list</span><br style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><a href="mailto:Labs-l@lists.wikimedia.org" style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">Labs-l@lists.wikimedia.org</a><br style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><a href="https://lists.wikimedia.org/mailman/listinfo/labs-l" style="font-family: Calibri; font-size: 16px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">https://lists.wikimedia.org/mailman/listinfo/labs-l</a></div></blockquote></div><br class=""></div></body></html>