Re user counts; we have, I think, 1 editor who has 1M+ edits. I imagine we don't have many with 100K edits. How big are those user groups? It's useful to know that power users are more likely to opt out, great, but if you only have 30 users in your definition of 'power users' it's going to be thrown off very easily.

My big worry would be that finding this out only tells you that either (1) only power users have a problem or (2) only power users can find the off-switch. Comparing with other features that also feature an off-switch would allow you to eliminate this as an independent variable.


On 9 June 2014 11:55, Gergo Tisza <gtisza@wikimedia.org> wrote:
On Mon, Jun 9, 2014 at 11:20 AM, Aaron Halfaker <ahalfaker@wikimedia.org> wrote:
Also, opt-out rates tend to be low no matter how obvious and desired they are.  If the goal of this analysis is to find out if opt-out rates are high (or low), then I'd recommend comparing them with opt-out rates for another feature.

One thing I did was to compare opt-out rates with other wikis where we have received fewer complaints (fr, es), and enwiki optouts seem to be in the same range. Do you think that is a useful indicator, or comparing optout rates for wikis with a different userbase size is not particularly useful?

_______________________________________________
Analytics mailing list
Analytics@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/analytics




--
Oliver Keyes
Research Analyst
Wikimedia Foundation