<html><head><meta http-equiv="Content-Type" content="text/html charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">We seem to be getting some dropped connections too on the xTools web service. Quite randomly, the edit counter reports blank info as well as the other tools that use the replicas, but refreshing fixes that problem.<div class=""><br class=""><div class="">
<div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Cyberpower678<br class="">English Wikipedia Account Creation Team<br class="">Mailing List Moderator</div><div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><br class=""></div><br class="Apple-interchange-newline">
</div>
<br class=""><div><blockquote type="cite" class=""><div class="">On Feb 15, 2015, at 11:38, Nuria Ruiz <<a href="mailto:nuria@wikimedia.org" class="">nuria@wikimedia.org</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class="">><span style="font-size:12.8000001907349px" class="">Which recent restart? The GHOST restarts in late January, or the labsdb restarts last week? Something else?</span><div style="font-size:12.8000001907349px" class="">The labs restart last week.</div><div style="font-size:12.8000001907349px" class=""><br class=""></div><div style="font-size:12.8000001907349px" class=""><br class=""></div><div style="font-size:12.8000001907349px" class="">><span style="font-size:12.8000001907349px" class="">Is there any pattern? Eg, time of day, specific queries, etc</span></div><div style="font-size:12.8000001907349px" class=""><span style="font-size:12.8000001907349px" class="">We do not have enough usage sin labs such we would see daily patterns or such but several queries were getting errors like </span><span style="font-size:12.8000001907349px" class=""> </span><span style="font-size:12.8000001907349px" class="">"MySQL server has gone away." Not all. Please see below.</span></div><div style="font-size:12.8000001907349px" class=""><br class=""></div><div style="font-size:12.8000001907349px" class="">><span style="font-size:12.8000001907349px" class="">What lead you to look at the problem? Is it definite that connections started dropping at a known point in time?</span></div><div style="font-size:12.8000001907349px" class=""><span style="font-size:12.8000001907349px" class="">Users complaining and us looking at logs. </span></div><div style="font-size:12.8000001907349px" class=""><span style="font-size:12.8000001907349px" class=""><br class=""></span></div><div style="font-size:12.8000001907349px" class=""><span style="font-size:12.8000001907349px" class=""><br class=""></span></div><div style="font-size:12.8000001907349px" class=""><span style="font-size:12.8000001907349px" class="">Some queries an errors:</span></div><div style="font-size:12.8000001907349px" class=""><span style="font-size:12.8000001907349px" class=""><br class=""></span></div><div style="" class=""><span style="font-size:12.8000001907349px" class="">OperationalError: (OperationalError) (2013, 'Lost connection to MySQL server during query') 'SELECT anon_1.user_id AS anon_1_user_id \nFROM (SELECT anon_2.user_id AS user_id, anon_2.count AS count \nFROM (SELECT revision_userindex.rev_user AS user_id, count(*) AS count \nFROM revision_userindex \nWHERE revision_userindex.rev_timestamp BETWEEN %s AND %s AND revision_userindex.rev_user IN (SELECT logging.log_user \nFROM logging \nWHERE logging.log_type = %s AND logging.log_action = %s AND logging.log_timestamp BETWEEN %s AND %s) GROUP BY revision_userindex.rev_user UNION ALL SELECT archive_userindex.ar_user AS user_id, count(*) AS count \nFROM archive_userindex \nWHERE archive_userindex.ar_timestamp BETWEEN %s AND %s AND archive_userindex.ar_user IN (SELECT logging.log_user \nFROM logging \nWHERE logging.log_type = %s AND logging.log_action = %s AND logging.log_timestamp BETWEEN %s AND %s) GROUP BY archive_userindex.ar_user) AS anon_2) AS anon_1 \nWHERE anon_1.user_id NOT IN (SELECT user_groups.ug_user \nFROM user_groups \nWHERE user_groups.ug_group = %s) GROUP BY anon_1.user_id \nHAVING SUM(anon_1.count) >= %s' ('20150115000000', '20150214000000', 'newusers', 'create', '20150115000000', '20150214000000', '20150115000000', '20150214000000', 'newusers', 'create', '20150115000000', '20150214000000', 'bot', 5)</span><br class=""></div><div style="" class=""><span style="font-size:12.8000001907349px" class=""><br class=""></span></div><div style="" class=""><span style="font-size:12.8000001907349px" class=""><br class=""></span></div><div style="" class=""><span style="font-size:12.8000001907349px" class=""><br class=""></span></div><div style="" class=""><div style="font-size:12.8000001907349px" class="">OperationalError: (OperationalError) (2006, 'MySQL server has gone away') 'SELECT user.user_id AS user_user_id, user.user_name AS user_user_name, user.user_real_name AS user_user_real_name, u</div><div style="font-size:12.8000001907349px" class="">ser.user_password AS user_user_password, user.user_newpassword AS user_user_newpassword, user.user_newpass_time AS user_user_newpass_time, user.user_email AS user_user_email, user.user_touche<span style="font-size:12.8000001907349px" class="">d AS user_user_touched, user.user_token AS user_user_token, user.user_email_authenticated AS user_user_email_authenticated, user.user_email_token AS user_user_email_token, user.user_email_tok</span></div><div style="font-size:12.8000001907349px" class="">en_expires AS user_user_email_token_expires, user.user_registration AS user_user_registration, user.user_editcount AS user_user_editcount \nFROM user \nWHERE user.user_name IN (%s, %s)' ('<span style="font-size:12.8000001907349px" class="">SOME', 'SOME')</span></div><div style="font-size:12.8000001907349px" class=""><br class=""></div><div style="font-size:12.8000001907349px" class=""><br class=""></div><div style="font-size:12.8000001907349px" class=""><br class=""></div></div><div style="font-size:12.8000001907349px" class=""><br class=""></div><div style="font-size:12.8000001907349px" class=""><br class=""></div></div><div class="gmail_extra"><br class=""><div class="gmail_quote">On Sun, Feb 15, 2015 at 7:25 AM, Russell Blau <span dir="ltr" class=""><<a href="mailto:russblau@imapmail.org" target="_blank" class="">russblau@imapmail.org</a>></span> wrote:<br class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class="">Sean Pringle <springle <at> <a href="http://wikimedia.org/" target="_blank" class="">wikimedia.org</a>> writes:<br class="">
<br class="">
> Which recent restart? The GHOST restarts in late January, or the labsdb<br class="">
restarts last week? Something else?<br class="">
><br class="">
><br class="">
> What error codes and messages are you seeing client side?<br class="">
><br class="">
> Is there any pattern? Eg, time of day, specific queries, etc<br class="">
> What lead you to look at the problem? Is it definite that connections<br class="">
started dropping at a known point in time?<br class="">
><br class="">
</span>I can give you some answers for a different project. Tool Labs project<br class="">
'dplbot' has a database job that runs twice a day. Starting after 18:00<br class="">
UTC on 8 Feb 2015, a particular PHP script that involves a lot of writes<br class="">
to a project database (p50380g50692__DPL_p) on enwiki.labsdb started to<br class="">
fail consistently with the error message "MySQL server has gone away." The<br class="">
script had not changed, and this error had not occurred before this time,<br class="">
but it now occurs every time we attempt to run this particular script.<br class="">
<br class="">
Russ<br class="">
_______________________________________________<br class="">
Labs-l mailing list<br class="">
<a href="mailto:Labs-l@lists.wikimedia.org" class="">Labs-l@lists.wikimedia.org</a><br class="">
<a href="https://lists.wikimedia.org/mailman/listinfo/labs-l" target="_blank" class="">https://lists.wikimedia.org/mailman/listinfo/labs-l</a><br class="">
</blockquote></div><br class=""></div>
_______________________________________________<br class="">Labs-l mailing list<br class=""><a href="mailto:Labs-l@lists.wikimedia.org" class="">Labs-l@lists.wikimedia.org</a><br class="">https://lists.wikimedia.org/mailman/listinfo/labs-l<br class=""></div></blockquote></div><br class=""></div></body></html>