Hi everyone,
For those of you who aren't aware, the Mobile Apps Team has been running an experiment in Wikipedia Beta on Android. We're trialling a single, visually appealing result at the end of articles instead of the three from "Read more". We're calling this "Read next". What happens is that approximately half of Wikipedia Beta users are shown read next on every article, and the other half are shown read more. Here's some example screenshots:
- Read next: http://i.imgur.com/StTLAPU.png - Read more: http://i.imgur.com/ecb2cy2.png
Here's the verdict of the test!
- Read more has a clickthrough rate of 15.4% (65,448 views, 10,600 clicks) - Read next has a clickthrough rate of 10.4% (59,668 views, 6,180 clicks)
So it would seem that read next is not as effective at driving clicks as read more is. Interesting!
Thanks, Dan
Whoa interesting!
On Mar 20, 2015, at 10:29 PM, Dan Garry dgarry@wikimedia.org wrote:
Hi everyone,
For those of you who aren't aware, the Mobile Apps Team has been running an experiment in Wikipedia Beta on Android. We're trialling a single, visually appealing result at the end of articles instead of the three from "Read more". We're calling this "Read next". What happens is that approximately half of Wikipedia Beta users are shown read next on every article, and the other half are shown read more. Here's some example screenshots: Read next: http://i.imgur.com/StTLAPU.png Read more: http://i.imgur.com/ecb2cy2.png Here's the verdict of the test! Read more has a clickthrough rate of 15.4% (65,448 views, 10,600 clicks) Read next has a clickthrough rate of 10.4% (59,668 views, 6,180 clicks) So it would seem that read next is not as effective at driving clicks as read more is. Interesting!
Thanks, Dan
-- Dan Garry Associate Product Manager, Mobile Apps Wikimedia Foundation _______________________________________________ Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
What's the distribution of the different positions clicked on in Read more? Pos 1, 2, 3? I bet #1 still gets the most but the other ones are probably not too far behind.
Since you used the word verdict. Does this imply we abandon Read next?
Bernd
On Fri, Mar 20, 2015 at 11:31 PM, Monte Hurd mhurd@wikimedia.org wrote:
Whoa interesting!
On Mar 20, 2015, at 10:29 PM, Dan Garry dgarry@wikimedia.org wrote:
Hi everyone,
For those of you who aren't aware, the Mobile Apps Team has been running an experiment in Wikipedia Beta on Android. We're trialling a single, visually appealing result at the end of articles instead of the three from "Read more". We're calling this "Read next". What happens is that approximately half of Wikipedia Beta users are shown read next on every article, and the other half are shown read more. Here's some example screenshots:
- Read next: http://i.imgur.com/StTLAPU.png
- Read more: http://i.imgur.com/ecb2cy2.png
Here's the verdict of the test!
- Read more has a clickthrough rate of 15.4% (65,448 views, 10,600
clicks)
- Read next has a clickthrough rate of 10.4% (59,668 views, 6,180
clicks)
So it would seem that read next is not as effective at driving clicks as read more is. Interesting!
Thanks, Dan
-- Dan Garry Associate Product Manager, Mobile Apps Wikimedia Foundation
Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
On 20 March 2015 at 22:36, Bernd Sitzmann bernd@wikimedia.org wrote:
What's the distribution of the different positions clicked on in Read more? Pos 1, 2, 3? I bet #1 still gets the most but the other ones are probably not too far behind.
Since you used the word verdict. Does this imply we abandon Read next?
Certainly we know that "Read more" drives more engagement. Therefore, for now I think we shouldn't use "Read next" in production.
Dan
Dan Garry, 21/03/2015 06:29:
So it would seem that read next is not as effective at driving clicks as read more is. Interesting!
Please make sure to add a very understandable qqq message documentation for "Read more". The word "more" is extremely hard to translate, I see horribly incorrect translations of it all over the web all the time (especially in badly translated products such as Google, Facebook, Twitter and similar).
Nemo
So while the result makes sense to me (it's what I would have expected) it seems like a multivariable test. I'm not sure I understand why you changed the wording of the title and just had them both be called Read more?
It certainly could be possible that "Read more" is just more inviting then "read next" because they think of it as the continuation of what they're already doing "more" rather then the "next" thing after they've finished what they came for. That said, my guess is that the change that is more important is that 3 images (under read more) offers more choice and so more (total) click through then the 1 image option. They are more likely to see something they are interested in :) (of course too many choices inevitably starts driving down overall click through but I think it makes sense that 3 is not at that point yet).
So we don't really have a great 'result' in my opinion... we probably have a "fine" result since I imagine we all think it's the number of images that did it but the two variables throws a wrench in knowing that for sure (I've certainly seen us find weirder causes during fundraising tests etc).
James Alexander Community Advocacy Wikimedia Foundation (415) 839-6885 x6716 @jamesofur
On Fri, Mar 20, 2015 at 10:29 PM, Dan Garry dgarry@wikimedia.org wrote:
Hi everyone,
For those of you who aren't aware, the Mobile Apps Team has been running an experiment in Wikipedia Beta on Android. We're trialling a single, visually appealing result at the end of articles instead of the three from "Read more". We're calling this "Read next". What happens is that approximately half of Wikipedia Beta users are shown read next on every article, and the other half are shown read more. Here's some example screenshots:
- Read next: http://i.imgur.com/StTLAPU.png
- Read more: http://i.imgur.com/ecb2cy2.png
Here's the verdict of the test!
- Read more has a clickthrough rate of 15.4% (65,448 views, 10,600
clicks)
- Read next has a clickthrough rate of 10.4% (59,668 views, 6,180
clicks)
So it would seem that read next is not as effective at driving clicks as read more is. Interesting!
Thanks, Dan
-- Dan Garry Associate Product Manager, Mobile Apps Wikimedia Foundation
Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Hi Dan!
Very interesting, thanks for sharing! Personally I can totally understand the result and would welcome it, if “read next” will not be introduces in Wikipedia (stable app). I want to see interesting articles and decide by myself, what topic I want to read next and don’t want, that a computer decide, what are interesting articles for me, if it isn’t based on my personal interests :)
Best,
Florian
Von: mobile-l-bounces@lists.wikimedia.org [mailto:mobile-l-bounces@lists.wikimedia.org] Im Auftrag von Dan Garry Gesendet: Samstag, 21. März 2015 06:30 An: mobile-l Betreff: [WikimediaMobile] [Apps] Read next vs Read more: the verdict
Hi everyone,
For those of you who aren't aware, the Mobile Apps Team has been running an experiment in Wikipedia Beta on Android. We're trialling a single, visually appealing result at the end of articles instead of the three from "Read more". We're calling this "Read next". What happens is that approximately half of Wikipedia Beta users are shown read next on every article, and the other half are shown read more. Here's some example screenshots:
* Read next: http://i.imgur.com/StTLAPU.png * Read more: http://i.imgur.com/ecb2cy2.png
Here's the verdict of the test!
* Read more has a clickthrough rate of 15.4% (65,448 views, 10,600 clicks) * Read next has a clickthrough rate of 10.4% (59,668 views, 6,180 clicks)
So it would seem that read next is not as effective at driving clicks as read more is. Interesting!
Thanks,
Dan
Nice results. I am not sure how the wording affected it, that is an interesting point.
It would also be interesting to try a 3 pane "Read More" the slides left/right. Meaning we have the larger more visual representation, but we still provide 3 options that the user can swipe left right. Maybe we even auto scroll to the right…
On Sat, Mar 21, 2015 at 2:57 PM, Florian Schmidt < florian.schmidt.welzow@t-online.de> wrote:
Hi Dan!
Very interesting, thanks for sharing! Personally I can totally understand the result and would welcome it, if “read next” will not be introduces in Wikipedia (stable app). I want to see interesting articles and decide by myself, what topic I want to read next and don’t want, that a computer decide, what are interesting articles for me, if it isn’t based on my personal interests :)
Best,
Florian
*Von:* mobile-l-bounces@lists.wikimedia.org [mailto: mobile-l-bounces@lists.wikimedia.org] *Im Auftrag von *Dan Garry *Gesendet:* Samstag, 21. März 2015 06:30 *An:* mobile-l *Betreff:* [WikimediaMobile] [Apps] Read next vs Read more: the verdict
Hi everyone,
For those of you who aren't aware, the Mobile Apps Team has been running an experiment in Wikipedia Beta on Android. We're trialling a single, visually appealing result at the end of articles instead of the three from "Read more". We're calling this "Read next". What happens is that approximately half of Wikipedia Beta users are shown read next on every article, and the other half are shown read more. Here's some example screenshots:
- Read next: http://i.imgur.com/StTLAPU.png
- Read more: http://i.imgur.com/ecb2cy2.png
Here's the verdict of the test!
- Read more has a clickthrough rate of 15.4% (65,448 views, 10,600
clicks)
- Read next has a clickthrough rate of 10.4% (59,668 views, 6,180
clicks)
So it would seem that read next is not as effective at driving clicks as read more is. Interesting!
Thanks,
Dan
--
Dan Garry
Associate Product Manager, Mobile Apps
Wikimedia Foundation
Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l