Neil, yeah, it is pre-computed, but for the sessions sunburst it's still a HUGE amount of data. Take a look at the TSV. It could be transformed into a much easier to read thing on the server. But I remember you saying nobody really uses that graph anyway, so we could also just remove it. Let's chat offline.
On Thu, Feb 11, 2016 at 2:17 PM, Neil P. Quinn nquinn@wikimedia.org wrote:
Dan,
When you say the huge amount of data is slowing the load, are you referring to the size of the Edit event logs? That wouldn't make sense since I thought the data is all pre-computed and loaded from the TSVs every time you load the page.
Anyway, as a heads-up to everyone, new data generation for that dashboard has been disabled since those logs have gotten too big. We've already reduced the volume of new Edit events to 20% of previous by increasing the sampling, and the DBAs are going to randomly purge existing events ( https://phabricator.wikimedia.org/T124676). Once that's done, we can turn the computations back on (https://phabricator.wikimedia.org/T126058).
On Wed, Feb 10, 2016 at 12:06 PM, Dan Andreescu dandreescu@wikimedia.org wrote:
On Wed, Feb 10, 2016 at 12:08 PM, Dan Andreescu <dandreescu@wikimedia.org
wrote:
What you're looking at now is the percent of edits that ended in an edit conflict since last April.
So when it says the average edit conflict rate for VisualEditor on 2015-10-07 was "0.01", does that mean 1% or 0.01%? I'm guessing 1%, but just want to clarify since the labels are ambiguous.
The rate is the number of times there was an edit conflict divided by the number of times a save was attempted. So yes, 0.0104 times out of 1, there was an edit conflict, which means 1.04% of the time.
The query for this, and the line you're interested in is here:
https://github.com/wikimedia/analytics-limn-edit-data/blob/master/edit/failu...
Also, the raw data behind that specific graph is here:
http://datasets.wikimedia.org/limn-public-data/metrics/failure_rates_by_type...
http://datasets.wikimedia.org/limn-public-data/metrics/failure_rates_by_type...
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
-- Neil P. Quinn https://meta.wikimedia.org/wiki/User:Neil_P._Quinn-WMF, product analyst Wikimedia Foundation
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics