On 15 April 2014 18:12, Steven Walling <steven.walling(a)gmail.com> wrote:
We don't have a powerful/easy to use/not
annoying/privacy-respecting survey
tool that can do side-by-side comparisons. This is why the feature was
launched using Beta Features for five months first. Putting out in opt-in
mode and gathering feedback via the channels we have now is the most
efficient way to make a change that doesn't have a big WMF team assigned to
like Multimedia or VisualEditor.
When it comes to using a survey to catch problems early and gauging
preferences, a survey still very much suffers from the self-selection bias
that all opt-in options have. It's just the name of the game. When you move
something from opt-in to opt-out you reach a wider audience and encounter
new complaints/questions/bugs.
... so the answer to "what user testing did you do, where are the user
test results" is "we didn't"?
- d.