Will surely take note for next time. Thanks!
Now that we've got the results from this test, we will soon update the app
to use *only* morelike suggestions, which means you'll be getting twice as
many morelike queries from the app as before. (We'll let you know when
that's released)
On Wed, Jul 29, 2015 at 4:17 PM, Oliver Keyes <okeyes(a)wikimedia.org>
wrote:
This is fantastic work to see!
For future work around this stuff, can I ask that you keep us in the
loop? When you build a feature like this, users get more things - and
search gets more queries, some that succeed and some but fail. But for
this email at the tail-end of the test we wouldn't know this was
happening, and it has the potential to mess with some of our core
KPIs.
On 29 July 2015 at 16:01, Dmitry Brant <dbrant(a)wikimedia.org> wrote:
moving to mobile-l, and cc Search &
Discovery.
---------- Forwarded message ----------
From: Dmitry Brant <dbrant(a)wikimedia.org>
Date: Wed, Jul 29, 2015 at 3:38 PM
Subject: "Morelike" suggestions - the results are in!
To: Internal communication for WMF Reading team
<reading-wmf(a)lists.wikimedia.org>
Hi all,
For the last few weeks, we've had an A/B test in the Android app where
we
measure user engagement with the "read
more" suggestions that we show
at the
bottom of each article. We display three
suggestions for further
reading,
based on either (A) a plain full-text search
query based on the title
of the
current article, or (B) a query using the
"morelike" feature in
CirrusSearch.
And the winner is... (perhaps not entirely surprisingly) "morelike"!
Users
who saw suggestions based on "morelike"
were over 20% more likely to
click
on one of the suggestions.
Here's a quick analysis and chart of the data from the last 10 days:
https://docs.google.com/spreadsheets/d/1BFsrAcPgexQyNVemmJ3k3IX5rtPvJ_5vdYO…
-Dmitry
_______________________________________________
Wikimedia-search mailing list
Wikimedia-search(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
--
Oliver Keyes
Research Analyst
Wikimedia Foundation
_______________________________________________
Mobile-l mailing list
Mobile-l(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mobile-l
_______________________________________________
Mobile-l mailing list
Mobile-l(a)lists.wikimedia.org