Neil, yeah, it is pre-computed, but for the sessions sunburst it's still a
HUGE amount of data. Take a look at the TSV. It could be transformed into
a much easier to read thing on the server. But I remember you saying
nobody really uses that graph anyway, so we could also just remove it.
Let's chat offline.
On Thu, Feb 11, 2016 at 2:17 PM, Neil P. Quinn <nquinn(a)wikimedia.org> wrote:
Dan,
When you say the huge amount of data is slowing the load, are you
referring to the size of the Edit event logs? That wouldn't make sense
since I thought the data is all pre-computed and loaded from the TSVs every
time you load the page.
Anyway, as a heads-up to everyone, new data generation for that dashboard
has been disabled since those logs have gotten too big. We've already
reduced the volume of new Edit events to 20% of previous by increasing the
sampling, and the DBAs are going to randomly purge existing events (
https://phabricator.wikimedia.org/T124676). Once that's done, we can turn
the computations back on (
https://phabricator.wikimedia.org/T126058).
On Wed, Feb 10, 2016 at 12:06 PM, Dan Andreescu <dandreescu(a)wikimedia.org>
wrote:
On Wed, Feb 10, 2016 at 12:08 PM, Dan Andreescu
<dandreescu(a)wikimedia.org
wrote:
What you're looking at now is the percent of
edits that ended in an
edit conflict since last April.
So when it says the average edit conflict rate for VisualEditor on
2015-10-07 was "0.01", does that mean 1% or 0.01%? I'm guessing 1%, but
just want to clarify since the labels are ambiguous.
The rate is the number of times there was an edit conflict divided by the
number of times a save was attempted. So yes, 0.0104 times out of 1, there
was an edit conflict, which means 1.04% of the time.
The query for this, and the line you're interested in is here:
https://github.com/wikimedia/analytics-limn-edit-data/blob/master/edit/fail…
Also, the raw data behind that specific graph is here:
http://datasets.wikimedia.org/limn-public-data/metrics/failure_rates_by_typ…
http://datasets.wikimedia.org/limn-public-data/metrics/failure_rates_by_typ…
_______________________________________________
Analytics mailing list
Analytics(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/analytics
--
Neil P. Quinn <https://meta.wikimedia.org/wiki/User:Neil_P._Quinn-WMF>,
product analyst
Wikimedia Foundation
_______________________________________________
Analytics mailing list
Analytics(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/analytics