Abbey and Daisy did some live user testing of WikiGrok version A out at Yerba Buena yesterday – here's their full write-up: https://www.mediawiki.org/wiki/Guerrilla_Testing_Wikigrok_Version_A

A few actionable/interesting takeaways:

1) This version (in-line) is definitely less obtrusive to the reader experience than the pop-up overlay of the initial WikiGrok prototype; people didn't react strongly to it and didn't seem to think it was anything unusual or surprising. I think this is a good sign – it means we're more likely to get answers from people who are carefully reading the article and notice the call to action, not random button-mashers ;)

2) The UX is very easy to use, virtually painless. Good designin', Moiz! The only potential issue is that the tap events are being triggered a bit inconsistently. You can see it for yourself if you play around with it on beta labs – sometimes it takes awhile for the buttons to register a tap, and if you're impatient and tap a few times, you might accidentally end up on the second screen tapping on "yes" before you've even had a chance to read the question. Might need to investigate ways to improve this (Juliusz's Microtap stuff?).

3) People thought this might be an alternative to editing or a new way to edit. A few who'd tried unsuccessfully to make an edit in the past even pointed out how much better/easier this is. Early days and small sample size, but it's cool to get a bit of validation of the hypothesis that we can engage a much wider audience with a feature like this, including people who would never otherwise contribute to Wikimedia projects :)

--
Maryana Pinchuk
Product Manager, Wikimedia Foundation
wikimediafoundation.org