The report card seems to only show data for the past month. Is there something I could check to verify if there was an overall drop in reader traffic over the last week?
The reason I ask is that Media Viewer actions seem to be dropping across the board since November 13th: http://multimedia-metrics.wmflabs.org/dashboards/mmv This trend is seen on all wikis. I'm trying to find the cause of this problem, because we're launching significant UI changes to all wikis today and we'll need to make sure that our EventLogging figures are accurate.
Based on http://stats.grok.se/en/201411/Main_Page I would imagine that there isn't any drop in reader traffic (which seems quite logical). I saw mentions of EventLogging DB problems in earlier threads, could it be that a lot of events didn't get recorded or something similar?
On Wed, Nov 19, 2014 at 12:41 PM, Gilles Dubuc gilles@wikimedia.org wrote:
The report card seems to only show data for the past month. Is there something I could check to verify if there was an overall drop in reader traffic over the last week?
The reason I ask is that Media Viewer actions seem to be dropping across the board since November 13th: http://multimedia-metrics.wmflabs.org/dashboards/mmv This trend is seen on all wikis. I'm trying to find the cause of this problem, because we're launching significant UI changes to all wikis today and we'll need to make sure that our EventLogging figures are accurate.
Hi Gilles,
On Wed, Nov 19, 2014 at 12:52:05PM +0100, Gilles Dubuc wrote:
I saw mentions of EventLogging DB problems in earlier threads, could it be that a lot of events didn't get recorded or something similar?
It seems besides to the two separate issues that we were seeing in the recent days, there is a third separate issue coming into the mix :-)
Not sure yet of the root cause, but while the counts in the logs are constant, I see that the counts in the database are lower than expected :-/
I'll have a look.
Have fun, Christian
Hi,
On Wed, Nov 19, 2014 at 04:58:37PM +0100, Christian Aistleitner wrote:
On Wed, Nov 19, 2014 at 12:52:05PM +0100, Gilles Dubuc wrote:
I saw mentions of EventLogging DB problems in earlier threads, could it be that a lot of events didn't get recorded or something similar?
[...]
I'll have a look.
It turned out that on 2014-11-14 event volume grew beyond what EventLogging's database writer could take.
https://wikitech.wikimedia.org/wiki/Incident_documentation/20141114-EventLog...
An improvement of the database writer got deployed 2014-11-20T21:00, and it could handle the volume since then easily. But the fix still has to pass today's busy hours.
This was a limitation of EventLogging's database writer, and not EventLogging itself. So the secondary logs that EventLogging keeps should be good. I'll see to get the database backfilled from them and update the above Incident documentation page accordingly.
Have fun, Christian