Thanks Oliver. As the analysis has now been published, I've marked our Q2 goal, which was to determine whether the feature is fit to push to production, as done https://www.mediawiki.org/w/index.php?title=Wikimedia_Engineering/2015-16_Q2_Goals&diff=1954490&oldid=1945100! \o/
Actual pushing of the feature to production can take place after the deployment freeze is over.
Thanks, Dan
On 1 December 2015 at 07:52, Oliver Keyes okeyes@wikimedia.org wrote:
Hey all,
I'm pleased to share the results of our language switching A/B test. This was an experiment to see if language detection on failed queries
- and then rerunning in the "appropriate" language - could produce a
better outcome for users.
The long and the short of it is that it does produce a marginally better outcome for web users, but not for API users. Our recommendation is to enable it as the default user experience for web users but NOT API users, if that is possible, and disable the test if not.
You can see the full report at https://github.com/wikimedia-research/LangTest/blob/master/report.pdf
Thanks!
-- Oliver Keyes Count Logula Wikimedia Foundation
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery