<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto"><div>Yikes. Cyberbot was the overall winner? O_o Cyberbot does do a lot of stuff.<br><br>Gesendet von Maximilian's iPhone. <div>(Sent from Maximilian's iPhone.)</div></div><div><br>On Oct 11, 2013, at 5:39, addshorewiki <<a href="mailto:addshorewiki@gmail.com">addshorewiki@gmail.com</a>> wrote:<br><br></div><blockquote type="cite"><div><div dir="ltr"><span class="">-rw-rw---- 1 50584 local-50584 990G Oct 10 17:59 bz2xml2sql.out</span></div><div class="gmail_extra"><br><br><div class="gmail_quote">On 11 October 2013 09:54, YiFei <span dir="ltr"><<a href="mailto:zhuyifei1999@gmail.com" target="_blank">zhuyifei1999@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">which log anyway?<br>
<br>
2013/10/11, Petr Bena <<a href="mailto:benapetr@gmail.com">benapetr@gmail.com</a>>:<br>
<div class="HOEnZb"><div class="h5">> 990 GIGABYTES in single file?<br>
><br>
> "Holy Jesus on a stick" --Debra Morgan<br>
><br>
> On Fri, Oct 11, 2013 at 7:21 AM, Marc-André Pelletier<br>
> <<a href="mailto:mpelletier@wikimedia.org">mpelletier@wikimedia.org</a>> wrote:<br>
>> Hello all,<br>
>><br>
>> The switch to the new NFS server hardware is now complete, with only 12<br>
>> hours of delay. :-)<br>
>><br>
>> Seriously though, the filesystem copy took so long because - despite<br>
>> having prepared with a copy a day early so that only a quick rsync would<br>
>> suffice - there ended up being a bit over 4T worth of files that were<br>
>> touched in that 24h period.<br>
>><br>
>> Log files, by their nature, are constantly updated. Normally, that<br>
>> shouldn't have been a major issue since the rsync would just copy them<br>
>> again... except that many of those log files were *hundreds of gigs* in<br>
>> size. This caused the filesystem resync to take a bit over 11 hours.<br>
>><br>
>> While Cyberbot was the overall winner, with very nearly 2G of logs to<br>
>> his name, our winner for most impressive single log is yifeibot with<br>
>> 990G in a single log file!<br>
>><br>
>> I would really much rather not have to turn quota on on our file system:<br>
>> it is very useful to be occasionally able to handle huge datasets.<br>
>> However, if users abuse the freedom I will have no choice but to do so<br>
>> in order to protect reliability and QoS.<br>
>><br>
>> So, the delay having been that long, some things may have broken that I<br>
>> was no longer able to notice (I've been at this for 14h straight, now,<br>
>> and need sleep). I'll be on hand tomorrow to help work out any kinks<br>
>> that may have slipped in.<br>
>><br>
>> On the positive side, however, we are now on new hardware for the NFS<br>
>> server and it seems to be working quite fine. Yeay!<br>
>><br>
>> -- Marc<br>
>><br>
>><br>
>> _______________________________________________<br>
>> Labs-l mailing list<br>
>> <a href="mailto:Labs-l@lists.wikimedia.org">Labs-l@lists.wikimedia.org</a><br>
>> <a href="https://lists.wikimedia.org/mailman/listinfo/labs-l" target="_blank">https://lists.wikimedia.org/mailman/listinfo/labs-l</a><br>
><br>
> _______________________________________________<br>
> Labs-l mailing list<br>
> <a href="mailto:Labs-l@lists.wikimedia.org">Labs-l@lists.wikimedia.org</a><br>
> <a href="https://lists.wikimedia.org/mailman/listinfo/labs-l" target="_blank">https://lists.wikimedia.org/mailman/listinfo/labs-l</a><br>
><br>
<br>
_______________________________________________<br>
Labs-l mailing list<br>
<a href="mailto:Labs-l@lists.wikimedia.org">Labs-l@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/labs-l" target="_blank">https://lists.wikimedia.org/mailman/listinfo/labs-l</a><br>
</div></div></blockquote></div><br></div>
</div></blockquote><blockquote type="cite"><div><span>_______________________________________________</span><br><span>Labs-l mailing list</span><br><span><a href="mailto:Labs-l@lists.wikimedia.org">Labs-l@lists.wikimedia.org</a></span><br><span><a href="https://lists.wikimedia.org/mailman/listinfo/labs-l">https://lists.wikimedia.org/mailman/listinfo/labs-l</a></span><br></div></blockquote></body></html>