Thanks Oliver. As the analysis has now been published, I've marked our Q2 goal, which was to determine whether the feature is fit to push to production, as done! \o/

Actual pushing of the feature to production can take place after the deployment freeze is over.

Thanks,
Dan

On 1 December 2015 at 07:52, Oliver Keyes <okeyes@wikimedia.org> wrote:

Hey all,

I'm pleased to share the results of our language switching A/B test.
This was an experiment to see if language detection on failed queries
- and then rerunning in the "appropriate" language - could produce a
better outcome for users.

The long and the short of it is that it does produce a marginally
better outcome for web users, but not for API users. Our
recommendation is to enable it as the default user experience for web
users but NOT API users, if that is possible, and disable the test if
not.

You can see the full report at
https://github.com/wikimedia-research/LangTest/blob/master/report.pdf

Thanks!

--
Oliver Keyes
Count Logula
Wikimedia Foundation

_______________________________________________
discovery mailing list
discovery@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/discovery

Dan Garry

Lead Product Manager, Discovery

Wikimedia Foundation