On Tue, Apr 15, 2014 at 11:23 AM, David Gerard <dgerard(a)gmail.com> wrote:
We don't
have a powerful/easy to use/not annoying/privacy-respecting
survey
tool that can do side-by-side comparisons. This
is why the feature was
launched using Beta Features for five months first. Putting out in opt-in
mode and gathering feedback via the channels we have now is the most
efficient way to make a change that doesn't have a big WMF team assigned
to
like Multimedia or VisualEditor.
When it comes to using a survey to catch problems early and gauging
preferences, a survey still very much suffers from the self-selection
bias
that all opt-in options have. It's just the
name of the game. When you
move
something from opt-in to opt-out you reach a
wider audience and encounter
new complaints/questions/bugs.
... so the answer to "what user testing did you do, where are the user
test results" is "we didn't"?
A survey and a user test are not the same thing. "User test" is also
slightly too generic for me to understand what you're asking. Are you
asking if we did scripted usability tests? Or are you asking if we ran an
A/B test with users?