On Fri, May 27, 2011 at 9:19 PM, Samuel Klein meta.sj@gmail.com wrote:
This is a nicely competent paper. Thanks for the heads up! SJ
Re-reading, I'm not sure I understand what the results mean. To continue the above quote:
Participants recruited by keep !voters were about four times less likely to support deletion as those recruited by delete !voters. The participants that bots recruited also appear unlikely to support deletion, which reflects the policy bias we observed earlier.
To see what effect participant recruitment has on decision quality, we introduce four binary variables: BotRecruit, NomRecruit, DeleteRecruit, and KeepRecruit. These variables indicate whether a bot, the AfD nominator, a delete !voter, or a keep !voter successfully recruited somebody to the group, respectively.
Looking back to table 1, we find that regardless of the decision, none of the first three variables has a statistically significant effect. On the other hand, when a keep !voter recruited someone to the discussion, we see a significant effect: delete decisions are more likely to be reversed.
So:
1. people recruited by a !keep voter (KeepRecruit) also tend to vote !keep 2. people recruited by a !delete voter (DeleteRecruit) tend neither way, both !delete and !keep 2.5. likewise for people recruited (NomRecruit) by the nominator (almost always a !delete voter, obviously) 3. people recruited by a bot (BotRecruit), like 2 & 2.5, have no 'statistically significant effect'
This is a little troubling for anyone who wants to argue that deleting fewer articles is the will of the people - the BotRecruits should then have been more likely to be !keepers.
We offer two possible explanations: the first is that recruitment by keep !voters, biased as it may appear, is a sign of positive community interest, and suggests that the article should be kept. If the community decides otherwise and deletes the article, then decision quality suffers. An alternative explanation is that keep !voter recruitment is a sign of activism among those who prefer to keep the article. These proponents may be especially persistent in maintaining the article’s existence in Wikipedia, even if it requires working to reverse a delete decision."
Obviously I prefer the first interpretation. With that one, the story becomes an article in an obscure niche is put for deletion by a boorish deletionist; in come the specialists who are not ignorant of the topic and literature and save it. If I saw an anime article that should not be deleted up for deletion, I wouldn't ask random Wikipedians to help, I'd go to what pass for anime experts on Wikipedia like Timothy Perper, who can look through the academic literature and have better access to media both English and Japanese. Looks like bias, smells like homophily, but really just the system working.