On 15 April 2014 18:12, Steven Walling steven.walling@gmail.com wrote:
We don't have a powerful/easy to use/not annoying/privacy-respecting survey tool that can do side-by-side comparisons. This is why the feature was launched using Beta Features for five months first. Putting out in opt-in mode and gathering feedback via the channels we have now is the most efficient way to make a change that doesn't have a big WMF team assigned to like Multimedia or VisualEditor. When it comes to using a survey to catch problems early and gauging preferences, a survey still very much suffers from the self-selection bias that all opt-in options have. It's just the name of the game. When you move something from opt-in to opt-out you reach a wider audience and encounter new complaints/questions/bugs.
... so the answer to "what user testing did you do, where are the user test results" is "we didn't"?
- d.