s1-analytics-slave.eqiad.wmnet/db1047 seems to be effectively down for database access.
Originally, it was showing odd behavior, such as hanging on a simple query against EventLogging with a LIMIT 1. Now, I can't even connect. Running:
mysql -u research
on stat1003 gives:
ERROR 2003 (HY000): Can't connect to MySQL server on 's1-analytics-slave.eqiad.wmnet' (110)
When it's back up, I will need to verify a new EventLogging instrumentation.
Matt Flaschen
On Mon, Apr 28, 2014 at 2:20 PM, Matthew Flaschen mflaschen@wikimedia.orgwrote:
s1-analytics-slave.eqiad.wmnet/db1047 seems to be effectively down for database access.
Originally, it was showing odd behavior, such as hanging on a simple query against EventLogging with a LIMIT 1. Now, I can't even connect. Running:
mysql -u research
on stat1003 gives:
ERROR 2003 (HY000): Can't connect to MySQL server on 's1-analytics-slave.eqiad.wmnet' (110)
I'm getting the same error.
On Mon, Apr 28, 2014 at 5:28 PM, Steven Walling swalling@wikimedia.orgwrote:
On Mon, Apr 28, 2014 at 2:20 PM, Matthew Flaschen <mflaschen@wikimedia.org
wrote:
s1-analytics-slave.eqiad.wmnet/db1047 seems to be effectively down for database access.
Originally, it was showing odd behavior, such as hanging on a simple query against EventLogging with a LIMIT 1. Now, I can't even connect. Running:
mysql -u research
on stat1003 gives:
ERROR 2003 (HY000): Can't connect to MySQL server on 's1-analytics-slave.eqiad.wmnet' (110)
I'm getting the same error.
These problems are most likely caused by the migration of the event logging database writer from db1047 to db1048. This has been ongoing since last Thursday and Sean has run into a series of issues since then. I'll cc him but he's aware of the problems and working to get db1047 back in full working order.
I will say that the connection problem seems intermittent, and probably coincides with him working on that machine. I was able to connect this morning and though there are other issues, i was able to issue some small simple selects.
Hi Matthew,
On Mon, Apr 28, 2014 at 05:20:49PM -0400, Matthew Flaschen wrote:
s1-analytics-slave.eqiad.wmnet/db1047 seems to be effectively down for database access.
Yup. Just to keep archives connected, the corresponding RT ticket is https://rt.wikimedia.org/Ticket/Display.html?id=7385
Best regards, Christian