This is fantastic work to see!
For future work around this stuff, can I ask that you keep us in the loop? When you build a feature like this, users get more things - and search gets more queries, some that succeed and some but fail. But for this email at the tail-end of the test we wouldn't know this was happening, and it has the potential to mess with some of our core KPIs.
On 29 July 2015 at 16:01, Dmitry Brant dbrant@wikimedia.org wrote:
moving to mobile-l, and cc Search & Discovery.
---------- Forwarded message ---------- From: Dmitry Brant dbrant@wikimedia.org Date: Wed, Jul 29, 2015 at 3:38 PM Subject: "Morelike" suggestions - the results are in! To: Internal communication for WMF Reading team reading-wmf@lists.wikimedia.org
Hi all,
For the last few weeks, we've had an A/B test in the Android app where we measure user engagement with the "read more" suggestions that we show at the bottom of each article. We display three suggestions for further reading, based on either (A) a plain full-text search query based on the title of the current article, or (B) a query using the "morelike" feature in CirrusSearch.
And the winner is... (perhaps not entirely surprisingly) "morelike"! Users who saw suggestions based on "morelike" were over 20% more likely to click on one of the suggestions.
Here's a quick analysis and chart of the data from the last 10 days:
https://docs.google.com/spreadsheets/d/1BFsrAcPgexQyNVemmJ3k3IX5rtPvJ_5vdYOy...
-Dmitry
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search