Hey all,
I am thrilled to announce a new formal collaboration [1] between the Wikimedia Foundation and a team of researchers at Stanford University, aiming to design and improve strategies to detect potential sockpuppets in Wikimedia projects. https://meta.wikimedia.org/wiki/Research:Sockpuppet_detection_in_Wikimedia_projects, part of the Wikimedia Foundation's community health program [2].
Sockpuppetry is the use of more than one account on a social platform. It is a major problem in Wikipedia, as it is frequently used for vandalism, paid editing, pushing one's point of view into articles, and bypassing the community guidelines. On English Wikipedia specifically, benign and malicious uses are well defined [3]. Recent research has elicited deceptive and non-deceptive behavior in online discussions, and identified that deceptive sockpuppets primarily aim to create illusion of consensus [4]. Our aim in this project is to design machine learning algorithms to identify potential sockpuppet accounts on English Wikipedia. We will leverage data from previously identified sockpuppets [5] to train our models for detection and create high precision models to identify new sockpuppets. The expected outcome of this project is a set of open algorithmic methods, and a report on their performance and limitations, that could be integrated later on into tools to support community efforts to identify and flag sockpuppet accounts.
I am excited to launch this collaboration with Srijan Kumar, Tilen Marc, Jure Leskovec and their group at Stanford, who have a solid record of research on this topic (and most recently also studied hoaxes in Wikipedia [6]).
You can follow the progress on this project on its page on Meta https://meta.wikimedia.org/wiki/Research:Sockpuppet_detection_in_Wikimedia_projects, where we'll be reporting the results, or chime in on the talk page https://meta.wikimedia.org/wiki/Research_talk:Sockpuppet_detection_in_Wikimedia_projects .
Dario
[1] https://www.mediawiki.org/wiki/Wikimedia_Research#Collaborations
[2] https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/2017-2018/F...
[3] Wikipedia:Sock puppetry. https://en.wikipedia.org/wiki/ Wikipedia:Sock_puppetry
[4] An Army of Me: Sockpuppets in Online Discussion Communities. S. Kumar, J. Cheng, J. Leskovec, V.S. Subrahmanian. *Proceedings of World Wide Web conference*, 2017.
[5] Category:Wikipedia sockpuppets. https://en.wikipedia.org/wiki/ Category:Wikipedia_sockpuppets
[6] https://meta.wikimedia.org/wiki/Research:Understanding_hoax_articles_on_Engl...