On Fri, Aug 10, 2012 at 8:19 AM, Russell Blau russblau@imapmail.org wrote:
Well, based on the overwhelming response to my last message, I guess nobody but me cares if thyme is lagged by three or four or five weeks....
I found your post very helpful for a status update of the current situation. The lag has a huge effect on the WP 1.0 bot that is used to track article assessments on enwiki, and which has a large user database as well.
Thyme finished processing the updates in the second block a few hours ago, but the replag is continuing to increase. This is very worrisome, and possibly there is something else going on there that the SHA-1 updates have been masking. All the TS admins seem to be on summer holiday; is there anyone around who has mysql root access and can look for problems on thyme?
Just to see if it makes any difference I killed the running WP 1.0 process on thyme. Right now the replag seems to be decreasing at a tiny rate, less than 10 minutes per hour. There are 411 hours of replag.
For what it's worth, I would personally prefer a short complete outage (or make the server read-only) if that would leave us with no replag, rather than waiting for weeks or months while the replag slowly decreases.
- Carl