I was just about to suggest this and, indeed, say that Oliver had done some similar work before :-)
If you look at (# of users who have opted out) / (# of users who have set preferences) you may get a more meaningful result - you'll be screening out all the ones who don't know how to or aren't comfortable with changing settings regardless of how badly it irritates them.
Andrew.
On 9 June 2014 21:36, Oliver Keyes okeyes@wikimedia.org wrote:
Re user counts; we have, I think, 1 editor who has 1M+ edits. I imagine we don't have many with 100K edits. How big are those user groups? It's useful to know that power users are more likely to opt out, great, but if you only have 30 users in your definition of 'power users' it's going to be thrown off very easily.
My big worry would be that finding this out only tells you that either (1) only power users have a problem or (2) only power users can find the off-switch. Comparing with other features that also feature an off-switch would allow you to eliminate this as an independent variable.
On 9 June 2014 11:55, Gergo Tisza gtisza@wikimedia.org wrote:
On Mon, Jun 9, 2014 at 11:20 AM, Aaron Halfaker ahalfaker@wikimedia.org wrote:
Also, opt-out rates tend to be low no matter how obvious and desired they are. If the goal of this analysis is to find out if opt-out rates are high (or low), then I'd recommend comparing them with opt-out rates for another feature.
One thing I did was to compare opt-out rates with other wikis where we have received fewer complaints (fr, es), and enwiki optouts seem to be in the same range. Do you think that is a useful indicator, or comparing optout rates for wikis with a different userbase size is not particularly useful?
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
-- Oliver Keyes Research Analyst Wikimedia Foundation
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics