Lag is down to ~ 16 hours for log and ~ 6 hours for enwiki.  I'm declaring victory.  Should be good by morning. 

On Tue, Jul 29, 2014 at 6:04 PM, Aaron Halfaker <> wrote:
Looks like I was right.  

I had a query writing to a table.  I thought it would finish last night, but it ran for > 24 hours.  I've killed it and changed the query so that it will write to an output file instead.  I restarted the query, but now lag seems to be recovering.  Lag is ~14 hours for enwiki and ~ 18 hours for log. 


On Tue, Jul 29, 2014 at 5:56 PM, Aaron Halfaker <> wrote:
This might be me.  Killing the query I'm worried about.   I'll report back. 

On Tue, Jul 29, 2014 at 5:46 PM, Christian Aistleitner <> wrote:

just a quick heads up that the replication lag on
analytics-store.eqiad.wmnet (aka “The one machine to rule them all”)
has risen to >12 hours for s1 replicas. Other replicas are fine.

So on analytics-store.eqiad.wmnet:
* enwiki is affected.
* log (EventLogging) is affected.

Other databases (like dewiki, eswiki, ...) on
analytics-store.eqiad.wmnet are /not/ affected.

For queries that only rely on enwiki, or log, you can use


as drop in replacement. enwiki and log are not lagging there.

I filed RT ticket 8032:

Best regards,

---- quelltextlich e.U. ---- \\ ---- Christian Aistleitner ----
                           Companies' registry: 360296y in Linz
Christian Aistleitner
Kefermarkterstrasze 6a/3     Email:
4293 Gutau, Austria          Phone:          +43 7946 / 20 5 81
                             Fax:            +43 7946 / 20 5 81

Analytics mailing list