<html><head></head><body><div style="color:#000; background-color:#fff; font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:13px"><div>That is good news for us all, jcrespo.</div><div><br></div><div>Cheers!<br></div><div id="yui_3_16_0_1_1448270451721_33327"><span></span></div> <br><div class="qtdSeparateBR"><br><br></div><div style="display: block;" class="yahoo_quoted"> <div style="font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 13px;"> <div style="font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 16px;"> <div dir="ltr"><font size="2" face="Arial"> On Monday, November 23, 2015 2:00 PM, Jaime Crespo <jcrespo@wikimedia.org> wrote:<br></font></div>  <br><br> <div class="y_msg_container"><div id="yiv7766800304"><div><div dir="ltr"><div>It seems that 2 out of 3 labs replica servers had crashed, creating corruption in the process. Replica lag is now going down.<br clear="none"><br clear="none"></div>Lag measuring (with 1 second resolution) is coming soon, will be available as a table, but I hit a bug and it is not being displayed correctly, so it is not yet public.<br clear="none">I will announce it as soon as it is fixed.<br clear="none"><div><br clear="none"></div></div><div class="yiv7766800304gmail_extra"><br clear="none"><div class="yiv7766800304gmail_quote">On Sun, Nov 22, 2015 at 10:06 PM, Yetkin Sakal <span dir="ltr"><<a rel="nofollow" shape="rect" ymailto="mailto:superyetkin@yahoo.com" target="_blank" href="mailto:superyetkin@yahoo.com">superyetkin@yahoo.com</a>></span> wrote:<br clear="none"><blockquote class="yiv7766800304gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;"><div class="yiv7766800304yqt0930326164" id="yiv7766800304yqt63744"><div><div style="color:#000;background-color:#fff;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:13px;">Thanks.<div><div class="yiv7766800304h5"><div><span></span></div> <br clear="none"><div><br clear="none"><br clear="none"></div><div style="display:block;"> <div style="font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:13px;"> <div style="font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:16px;"> <div dir="ltr"><font size="2" face="Arial"> On Sunday, November 22, 2015 10:52 PM, John <<a rel="nofollow" shape="rect" ymailto="mailto:phoenixoverride@gmail.com" target="_blank" href="mailto:phoenixoverride@gmail.com">phoenixoverride@gmail.com</a>> wrote:<br clear="none"></font></div>  <br clear="none"><br clear="none"> <div><div><div><div dir="ltr">I have <a rel="nofollow" shape="rect" target="_blank" href="http://tools.wmflabs.org/betacommand-dev/cgi-bin/replag">http://tools.wmflabs.org/betacommand-dev/cgi-bin/replag</a> which gives a rough estimate, plus we have <a rel="nofollow" shape="rect" target="_blank" href="https://phabricator.wikimedia.org/T119315">https://phabricator.wikimedia.org/T119315</a><br clear="none"></div><div><br clear="none"><div>On Sun, Nov 22, 2015 at 3:26 PM, Yetkin Sakal <span dir="ltr"><<a rel="nofollow" shape="rect" ymailto="mailto:superyetkin@yahoo.com" target="_blank" href="mailto:superyetkin@yahoo.com">superyetkin@yahoo.com</a>></span> wrote:<br clear="none"><blockquote style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;"><div><div><div style="color:#000;background-color:#fff;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:13px;"><div dir="ltr">Is there anywhere I can keep track of the status pertaining to the replication lag on s3? My tools are showing data from nearly a day ago.<br clear="none"></div></div></div></div><br clear="none">_______________________________________________<br clear="none">
Labs-l mailing list<br clear="none">
<a rel="nofollow" shape="rect" ymailto="mailto:Labs-l@lists.wikimedia.org" target="_blank" href="mailto:Labs-l@lists.wikimedia.org">Labs-l@lists.wikimedia.org</a><br clear="none">
<a rel="nofollow" shape="rect" target="_blank" href="https://lists.wikimedia.org/mailman/listinfo/labs-l">https://lists.wikimedia.org/mailman/listinfo/labs-l</a><br clear="none">
<br clear="none"></blockquote></div><br clear="none"></div></div></div><br clear="none"><br clear="none"></div>  </div> </div>  </div></div></div></div></div></div><br clear="none">_______________________________________________<br clear="none">
Labs-l mailing list<br clear="none">
<a rel="nofollow" shape="rect" ymailto="mailto:Labs-l@lists.wikimedia.org" target="_blank" href="mailto:Labs-l@lists.wikimedia.org">Labs-l@lists.wikimedia.org</a><br clear="none">
<a rel="nofollow" shape="rect" target="_blank" href="https://lists.wikimedia.org/mailman/listinfo/labs-l">https://lists.wikimedia.org/mailman/listinfo/labs-l</a><br clear="none">
<br clear="none"></blockquote></div><br clear="none"><br clear="all"><br clear="none">-- <br clear="none"><div class="yiv7766800304gmail_signature"><div dir="ltr"><div>Jaime Crespo<br clear="none"></div><<a rel="nofollow" shape="rect" target="_blank" href="http://wikimedia.org/">http://wikimedia.org</a>><br clear="none"></div></div>
</div></div></div><br><br></div>  </div> </div>  </div></div></body></html>