Hi,
it seems that since some hours, the analytics s1 slave (s1-analytics-slave.eqiad.wmnet, db1047.eqiad.wmnet) database cannot by reached at all via mysql.
This affects all services using enwiki (like geowiki), but also all services relying on EventLogging.
I filed RT ticket #7385: https://rt.wikimedia.org/Ticket/Display.html?id=7385
Best regards, Christian
P.S.: Sean indicated [1] that there are problems around db1047 and masters, so it might be a related, temporary issue. But Icinga shows also non-db related critical errors.
[1] http://lists.wikimedia.org/pipermail/analytics/2014-April/001900.html
Thanks Christian. I'm speaking with Jeff Gage and he has been working with Chase on the db1047.
They will update the ops list shortly.
On Mon, Apr 28, 2014 at 3:21 PM, Christian Aistleitner < christian@quelltextlich.at> wrote:
Hi,
it seems that since some hours, the analytics s1 slave (s1-analytics-slave.eqiad.wmnet, db1047.eqiad.wmnet) database cannot by reached at all via mysql.
This affects all services using enwiki (like geowiki), but also all services relying on EventLogging.
I filed RT ticket #7385: https://rt.wikimedia.org/Ticket/Display.html?id=7385
Best regards, Christian
P.S.: Sean indicated [1] that there are problems around db1047 and masters, so it might be a related, temporary issue. But Icinga shows also non-db related critical errors.
[1] http://lists.wikimedia.org/pipermail/analytics/2014-April/001900.html
-- ---- quelltextlich e.U. ---- \ ---- Christian Aistleitner ---- Companies' registry: 360296y in Linz Christian Aistleitner Gruendbergstrasze 65a Email: christian@quelltextlich.at 4040 Linz, Austria Phone: +43 732 / 26 95 63 Fax: +43 732 / 26 95 63 Homepage: http://quelltextlich.at/
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Hi,
On Mon, Apr 28, 2014 at 04:15:33PM -0700, Toby Negrin wrote:
I'm speaking with Jeff Gage and he has been working with Chase on the db1047.
Thanks Jeff, Chase, and Toby!
The analytics s1 slave is up and working again.
The EventLogging tables are still having the same problems around the EventLogging migration as they had before the downtime [1], but the slave allows mysql connections again the s1 replica is back and fully usable again.
So geowiki and other services relying only on s1's enwiki and not EventLogging should catch up today.
Best regards, Christian
[1] http://lists.wikimedia.org/pipermail/analytics/2014-April/001890.html