<div dir="ltr"><div dir="ltr"><div dir="ltr">Indeed, on desktop mouse cursor can be a decent proxy for gaze. I can't remember if it was the particular paper you've quoted where I read about it, but I seem to recall that the correlation varied quite a bit from one person to another. Essentially some people point the mouse to where they're looking, but others don't.</div><div dir="ltr"><br></div><div dir="ltr"><div>This paper by Microsoft about cursor position is also relevant: <a href="https://phabricator.wikimedia.org/T165272#3955001">https://phabricator.wikimedia.org/T165272#3955001</a> but it shows the limitations of predicting things based on cursor position when the person doesn't know what they're looking for when they land on the page. It works really well for the use case of people looking for "Facebook" on Bing to go to Facebook. Which probably has some muscle memory to it, i.e. people who do that already know where they're going to move their mouse to.</div><div><br></div><div>This is the paper that got me interested in gaze tracking for performance: <a href="https://phabricator.wikimedia.org/T165272#3933730">https://phabricator.wikimedia.org/T165272#3933730</a> It has limitations in terms of methodology, with people watching videos and playing a guessing game instead of having a more natural browsing experience, but the results are impressive. Enough to make me want to investigate what people look at on a Wikipedia page as it's loading, to inform our decisions about how we prioritise page elements.<br></div><div><br></div><div>The upside of doing a study with a device like the Tobii 4C is that we can also verify at the same time the correlation between gaze and cursor position.</div></div></div></div><br><div class="gmail_quote"><div dir="ltr">On Fri, Nov 9, 2018 at 5:54 PM Aaron Halfaker <<a href="mailto:ahalfaker@wikimedia.org">ahalfaker@wikimedia.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div dir="ltr"><div class="gmail_quote"><div><div>See also: Chen, M. C., Anderson, J. R., & Sohn, M. H. (2001, March). What can a mouse cursor tell us more?: correlation of eye/mouse movements on web browsing. In CHI'01 extended abstracts on Human factors in computing systems (pp. 281-282). ACM. (I can provide the PDF on request -- too big to attach)</div><div><br></div><div>Kim, N. W., Bylinskii, Z., Borkin, M. A., Gajos, K. Z., Oliva, A., Durand, F., & Pfister, H. (2017). BubbleView: an interface for crowdsourcing image importance maps and tracking visual attention. ACM Transactions on Computer-Human Interaction (TOCHI), 24(5), 36. <a href="https://arxiv.org/pdf/1702.05150" target="_blank">https://arxiv.org/pdf/1702.05150</a> </div><div><br></div><div>I don't know how readily available mouse-based attention tracking solutions are. But from the literature, it seems like there are good options for understanding attention through purely software means. </div><div><br></div><div>-Aaron</div></div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="gmail_quote"><div dir="ltr">On Fri, Nov 9, 2018 at 11:24 AM Tilman Bayer <<a href="mailto:tbayer@wikimedia.org" target="_blank">tbayer@wikimedia.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr">Nice! Added a link at <a href="https://meta.wikimedia.org/wiki/Research:Which_parts_of_an_article_do_readers_read#Eyetracking" target="_blank">https://meta.wikimedia.org/wiki/Research:Which_parts_of_an_article_do_readers_read#Eyetracking</a></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Nov 9, 2018 at 3:38 AM, Gilles Dubuc <span dir="ltr"><<a href="mailto:gilles@wikimedia.org" target="_blank">gilles@wikimedia.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div>I've just discovered and received today an amazing piece of hardware that a lot of you might find useful. It's called the <a href="https://tobiigaming.com/product/tobii-eye-tracker-4c/" target="_blank">Tobii Eye Tracker 4C</a>, which can be used with the <a href="https://www.tobiipro.com/sprint/" target="_blank">Tobii Pro Sprint</a> hosted service.</div><div><br></div><div>I've recorded a video demo of it here: <a href="https://www.mediawiki.org/wiki/File:Tobii_Eye_Tracker_4C_demo.webm" target="_blank">https://www.mediawiki.org/wiki/File:Tobii_Eye_Tracker_4C_demo.webm</a></div><div><br></div><div>This could allow us to do lab user testing where we record gaze cheaply and very easily.</div></div></div></div>
<br>_______________________________________________<br>
Research-Internal mailing list<br>
<a href="mailto:Research-Internal@lists.wikimedia.org" target="_blank">Research-Internal@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/research-internal" rel="noreferrer" target="_blank">https://lists.wikimedia.org/mailman/listinfo/research-internal</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="m_7865260301266438226gmail-m_-5209211109463402670m_-8814379275580618257gmail_signature">Tilman Bayer<br>Senior Analyst<br>Wikimedia Foundation<br>IRC (Freenode): HaeB</div>
</div>
_______________________________________________<br>
Research-Internal mailing list<br>
<a href="mailto:Research-Internal@lists.wikimedia.org" target="_blank">Research-Internal@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/research-internal" rel="noreferrer" target="_blank">https://lists.wikimedia.org/mailman/listinfo/research-internal</a><br>
</blockquote></div>
</blockquote></div></div></div>
_______________________________________________<br>
Engineering mailing list<br>
<a href="mailto:Engineering@lists.wikimedia.org" target="_blank">Engineering@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/engineering" rel="noreferrer" target="_blank">https://lists.wikimedia.org/mailman/listinfo/engineering</a><br>
</blockquote></div>