lol @ my, erm, heterogeneous list of contributions – Ukrainian riot police and basketball uniforms! :)

Watching these made me think about one thing we should probably start to pay more attention to: the network of usertesting.com users we've built up over the years. I've definitely seen two of these folks (misterbeauds and kayaker) before in usertesting tests I've run, which means they've had an unusual amount of exposure to the details of Wikipedia UI, both current and planned. That probably partly explains why they seem to know about things like page history, watchlist, etc., without being "real" editors. 

Every time I put a test up on usertesting.com, I get at least one of those repeat testers – probably because our Wikipedia tests are a lot more fun than whatever standard eyeball monetization software these people normally have to endure ;) But that means we might be underestimating their level of expertise (since they're not truly naive users) and over-representing their views of our UI improvements (since they tend to offer up similar soundbites time after time – e.g., kayaker's "this looks like code" and "I don't want to mess anything up," which I've heard her say before).

Anyway, just something for our future Lead UX Researcher to tackle, probably with a detailed database/registry of past testers :)

On Fri, Mar 7, 2014 at 7:01 PM, Brandon Harris <bharris@wikimedia.org> wrote:

        The first battery of user tests have completed against the Winter prototype.  I have included links to all of them at the main Winter page:

                https://www.mediawiki.org/wiki/Winter#Harness_One:_Winter

        All tests are annotated, but highlights are included in-line.

        The primary take-aways are:

                * No tester had difficulty recognizing the search bar.
                * All testers quickly grasped the in-page context action ribbon.
                * Several testers expressed surprise that Wikipedia had discussions, which lends even more credence to the idea that Vector tabs are effectively invisible.
                * The "Cancel" button from the editor may need work.
                * All testers found their way to the contributions page, even when faced with bugs/difficulties.  They just did it in other routes.

        I am very pleased with the results.

        I’ve created a Flow discussion about this here:

                https://www.mediawiki.org/w/index.php?title=Talk:Winter&topic_postId=rqjdm79t36svcvf2&workflow=rqjdm79t36svcvf2

---
Brandon Harris, Senior Designer, Wikimedia Foundation

Support Free Knowledge: http://wikimediafoundation.org/wiki/Donate


_______________________________________________

Wmfproduct mailing list
Wmfproduct@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wmfproduct

--

Maryana Pinchuk
Product Manager, Wikimedia Foundation
wikimediafoundation.org

_______________________________________________
Design mailing list
Design@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/design