Hey all,
A couple of weeks ago we ran an A/B test on the Wikipedia portal (www.wikipedia.org) to test whether a more prominent search box, optionally combined with additional metadata such as small images in the search results, would increase the rate at which people clicked through from the portal to one of our projects.
We are delighted to say that the test showed a 1-5% increase in the clickthrough rate, where both a prominent search box and metadata is used. Accordingly, once we've resolved concerns about the design's non-JavaScript usability, we hope to deploy it for all users.
The report can be seen at https://commons.wikimedia.org/wiki/File:First_Portal_Test.pdf - please let me know if you have any questions.
For Discovery Analytics,
Oliver,
Have we looked at this for the sister wikis? Can we? Some of those could do with search functionality for their portals, let alone some good result sets. It would be reasonable that the work that the discovery team was undertaking was being applied fully across the Wikimedia sites.
Regards, Billinghurst
On Thu, Jan 28, 2016 at 10:44 PM, Oliver Keyes okeyes@wikimedia.org wrote:
Hey all,
A couple of weeks ago we ran an A/B test on the Wikipedia portal (www.wikipedia.org) to test whether a more prominent search box, optionally combined with additional metadata such as small images in the search results, would increase the rate at which people clicked through from the portal to one of our projects.
We are delighted to say that the test showed a 1-5% increase in the clickthrough rate, where both a prominent search box and metadata is used. Accordingly, once we've resolved concerns about the design's non-JavaScript usability, we hope to deploy it for all users.
The report can be seen at https://commons.wikimedia.org/wiki/File:First_Portal_Test.pdf - please let me know if you have any questions.
For Discovery Analytics,
-- Oliver Keyes Count Logula Wikimedia Foundation
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
We haven't but I would really love to! Ultimately it means a set of infrastructural changes to our logging, and I imagine(?) how we deploy tests since each portal has a different repository, but I would love to see us test on at least one sister site as well as the wikipedia portal. The product manager's call, though - Deb?
On 29 January 2016 at 07:09, billinghurst billinghurstwiki@gmail.com wrote:
Oliver,
Have we looked at this for the sister wikis? Can we? Some of those could do with search functionality for their portals, let alone some good result sets. It would be reasonable that the work that the discovery team was undertaking was being applied fully across the Wikimedia sites.
Regards, Billinghurst
On Thu, Jan 28, 2016 at 10:44 PM, Oliver Keyes okeyes@wikimedia.org wrote:
Hey all,
A couple of weeks ago we ran an A/B test on the Wikipedia portal (www.wikipedia.org) to test whether a more prominent search box, optionally combined with additional metadata such as small images in the search results, would increase the rate at which people clicked through from the portal to one of our projects.
We are delighted to say that the test showed a 1-5% increase in the clickthrough rate, where both a prominent search box and metadata is used. Accordingly, once we've resolved concerns about the design's non-JavaScript usability, we hope to deploy it for all users.
The report can be seen at https://commons.wikimedia.org/wiki/File:First_Portal_Test.pdf - please let me know if you have any questions.
For Discovery Analytics,
-- Oliver Keyes Count Logula Wikimedia Foundation
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
Yup, we'd like to move forward with updating the sister wiki pages as well - once we've determined the "good" stuff on the Wikipedia portal site. Stay tuned! :)
Cheers,
Deb
-- Deb Tankersley Product Manager, Discovery Wikimedia Foundation
On Fri, Jan 29, 2016 at 7:56 AM, Oliver Keyes okeyes@wikimedia.org wrote:
We haven't but I would really love to! Ultimately it means a set of infrastructural changes to our logging, and I imagine(?) how we deploy tests since each portal has a different repository, but I would love to see us test on at least one sister site as well as the wikipedia portal. The product manager's call, though - Deb?
On 29 January 2016 at 07:09, billinghurst billinghurstwiki@gmail.com wrote:
Oliver,
Have we looked at this for the sister wikis? Can we? Some of those could do with search functionality for their portals, let alone some good result sets. It would be reasonable that the work that the discovery team was undertaking was being applied fully across the Wikimedia sites.
Regards, Billinghurst
On Thu, Jan 28, 2016 at 10:44 PM, Oliver Keyes okeyes@wikimedia.org
wrote:
Hey all,
A couple of weeks ago we ran an A/B test on the Wikipedia portal (www.wikipedia.org) to test whether a more prominent search box, optionally combined with additional metadata such as small images in the search results, would increase the rate at which people clicked through from the portal to one of our projects.
We are delighted to say that the test showed a 1-5% increase in the clickthrough rate, where both a prominent search box and metadata is used. Accordingly, once we've resolved concerns about the design's non-JavaScript usability, we hope to deploy it for all users.
The report can be seen at https://commons.wikimedia.org/wiki/File:First_Portal_Test.pdf - please let me know if you have any questions.
For Discovery Analytics,
-- Oliver Keyes Count Logula Wikimedia Foundation
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
-- Oliver Keyes Count Logula Wikimedia Foundation
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery