Christian Aistleitner, 15/01/2015 14:22:
If WMF's main form of QA was through automated usage data collection, you'd have a point.
Aaron Halfaker, 15/01/2015 16:23:
You hold a minority opinion that testing software in the field is unnecessary. [...]
Allow me to share a specific example. In this study[1], we found that telling anonymous editors to register dropped their productivity by *25%.*
IMHO you two are actually saying the same thing on this specific example, and I agree with both. Not collecting data about IE10 users would not increase the number of *bugs* they experience. Research about our users gives important results: a finding like this would not be impeded by ignoring IE10.
At a more general level, the conclusion is harder.
Nemo