Hello Researchers,
Contribution patterns in online communities follow a power distribution which is known as the 1% rule [1], as Wikipedia told me.
However, the steepness of the distribution can be more or less strong: 50% of your edits could be contributed by 2% or by 0.002%, the latter showing a stronger imbalance.
I wonder if there are any estimates/rules-of-thumb of what imbalance is problematic when seen from the perspective of community health.
I also wonder if there is research on how technology contributes to such imbalances and how it might be mitigated – e.g training, user-friendliness, documentation… (based on my assumption that a steep curve is less desirable, since the power is more concentrated, the system more fragile and the redistribution of power more constrained)
Jan
[1] https://en.wikipedia.org/wiki/1%25_rule_(Internet_culture)
Hi Jan,
There are many issues involved in power dynamics. I would prefer to look at this issue from a wide angle perspective.
How do you define "community health"?
Are the people who have power competent and focused on public service, are they incompetent and selfish, or some other combination of those factors?
There are also powerful non-community forces such as paid editors who have conflicts of interest, nations which make legal and political decisions that affect the community, trolls, political activists, WMF, and more. These can have significant effects for better and for worse. I suggest that you take these into your account in analyzing power dynamics.
I also suggest taking into account that even if someone is high on the power curve, that doesn't mean that they are necessarily having a good time at others' expense. I think that some people such as English Wikipedia functionaries are sometimes under a lot of stress, and are subject to criticism and scrutiny from many directions. Also, there may be good reasons for not distributing power more widely in some cases, such as with the Checkuser tool.
I worry that someday the community will be overwhelmed by organizations and/or nations which want to alter Wikimedia content for selfish reasons and who can afford to hire or manipulate large numbers of people into doing what they want.
What is the goal of your research?
Pine ( https://meta.wikimedia.org/wiki/User:Pine )
On Wed, Jan 22, 2020 at 10:31 AM Jan Dittrich jan.dittrich@wikimedia.de wrote:
Hello Researchers,
Contribution patterns in online communities follow a power distribution which is known as the 1% rule [1], as Wikipedia told me.
However, the steepness of the distribution can be more or less strong: 50% of your edits could be contributed by 2% or by 0.002%, the latter showing a stronger imbalance.
I wonder if there are any estimates/rules-of-thumb of what imbalance is problematic when seen from the perspective of community health.
I also wonder if there is research on how technology contributes to such imbalances and how it might be mitigated – e.g training, user-friendliness, documentation… (based on my assumption that a steep curve is less desirable, since the power is more concentrated, the system more fragile and the redistribution of power more constrained)
Jan
[1] https://en.wikipedia.org/wiki/1%25_rule_(Internet_culture)
-- Jan Dittrich UX Design/ Research
Wikimedia Deutschland e. V. | Tempelhofer Ufer 23-24 | 10963 Berlin Tel. (030) 219 158 26-0 https://wikimedia.de
Unsere Vision ist eine Welt, in der alle Menschen am Wissen der Menschheit teilhaben, es nutzen und mehren können. Helfen Sie uns dabei! https://spenden.wikimedia.de
Wikimedia Deutschland — Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/029/42207. _______________________________________________ Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
As someone who would qualify as a "very active editor"
https://en.wikipedia.org/wiki/Wikipedia:List_of_Wikipedians_by_number_of_edi...
I can honestly say that power and activity are definitely not the same thing on Wikipedia.
Do I have power? I don't think so. I am not an administrator or other functionary that has power over anyone else.
As a person who is principally a content writer, I get my time wasted every day by vandals, by content cited to reliable sources being removed by someone who simply doesn't agree with it but provides no sources to the contrary buts simply writes "Fact!" as an edit summary, that I have to explain to yet another American that we spell things differently in Australia and that is why there is a {{Use Australian English}} template on the top of that article, that "City of Brisbane" cannot be changed as "Brisbane City" as they are NOT the same thing (one is a local government area, the other a suburb, one about 100 times the area of the other) even if they do happen to "look like the same thing" or "think it reads better than way". I wish I did have the power to just "whack a mole" and NOT have to have these *same* conversations over and over and over again with me being WP:CIVIL and them often being not civil (some even track me down in real life and send me abusive e-mail off-wiki, including sexual remarks because I'm a self-identified female contributor). But in Wikipedia, that's OK because ArbCom decided that calling a female contributor "a cunt" isn't that bad. It's Wikipedia not Wokepedia! If I share the contents of that email on-wiki, I'm the one in trouble (their right to privacy), so I just delete them. If I spot a user name whitewashing a politican's article that just happens to be very similar indeed to the real life name of their media advisor, I cannot say that on-wiki, because that's WP:OUTING.
My "community health" is pretty damn poor precisely because we give the same power to every first time anonymous editor as we do to very active editors and we give it effectively to the most persistent and the most unpleasant. BRD is all very well if all involved are seriously trying to get the content right and well-cited. It fails completely when the other party is not engaging with it, being unpleasant, or just returning time and time again to re-do a problematic edit based on "I know this". We have problems with acts of vandalism that get repeated time and time again by a series of different IP addresses. This is impossible to block, we have no solution for it. If you want to see the scale of it, there's series of IP addresses that collectively exhibit similar patterns of thousands of problematic edits in my topic space going back to at least 2013 and were still active in 2019
https://en.wikipedia.org/wiki/User:IamNotU/History_cleanup
Do we have the power to "whack a mole" the first time we see any of these behaviour YET AGAIN? No, we don't. We have a lot of tedious process of having to find the right admin noticeboard, submit a request with the right templates, provide endless diffs, and then have nothing happen. We make it easy for people to create problems, but extremely difficult to get them stopped and incredibly tedious to clean up after them (you often can't "undo" because of intervening edits etc and these folk can do 100s of edits in a day). Here's one:
https://xtools.wmflabs.org/ec/en.wikipedia.org/Shelati
An editor who did a mass change over every suburb of Sydney over a couple days. I suspected them immediately as being a sockpuppet (behaviour was characteristic of "sockpuppet") but unless you can identify the sockmaster, you can't report it. So, instead the changes being made were discussed on the appropriate topic noticeboards, disagreed with, but then the editor was blocked by someone who figured out who the sockmaster was (a sockmaster dating back to 2009). The account was blocked, but the problematic edits have never been cleaned up.
Most active contributors who retire do so because of the behaviour of other "contributors" wears them down.
In summary, power in Wikipedia is not where you think it is on the curve. It is the power we give to the many people to do the same vandalism, the same "meant well but I'm stupid" edits, the same "I don't know any policies and they don't apply to me anyway" edits, and the sockpuppets and conflict-of-interest editors who carefully hide themselves among them.
I wish I had just a little power to exercise in topic spaces where I am knowledgeable and have a long history of positive contribution. I don't want it for baseball players or Icelandic musicians or Pokemon characters, just for Queensland history and geography. That's all I ask.
Kerry
-----Original Message----- From: Wiki-research-l [mailto:wiki-research-l-bounces@lists.wikimedia.org] On Behalf Of Jan Dittrich Sent: Wednesday, 22 January 2020 8:31 PM To: Wiki Research-l wiki-research-l@lists.wikimedia.org Subject: [Wiki-research-l] Power law and contributions:
Hello Researchers,
Contribution patterns in online communities follow a power distribution which is known as the 1% rule [1], as Wikipedia told me.
However, the steepness of the distribution can be more or less strong: 50% of your edits could be contributed by 2% or by 0.002%, the latter showing a stronger imbalance.
I wonder if there are any estimates/rules-of-thumb of what imbalance is problematic when seen from the perspective of community health.
I also wonder if there is research on how technology contributes to such imbalances and how it might be mitigated – e.g training, user-friendliness, documentation… (based on my assumption that a steep curve is less desirable, since the power is more concentrated, the system more fragile and the redistribution of power more constrained)
Jan
[1] https://en.wikipedia.org/wiki/1%25_rule_(Internet_culture)
-- Jan Dittrich UX Design/ Research
Wikimedia Deutschland e. V. | Tempelhofer Ufer 23-24 | 10963 Berlin Tel. (030) 219 158 26-0 https://wikimedia.de
Unsere Vision ist eine Welt, in der alle Menschen am Wissen der Menschheit teilhaben, es nutzen und mehren können. Helfen Sie uns dabei! https://spenden.wikimedia.de
Wikimedia Deutschland — Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/029/42207. _______________________________________________ Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Hi Jan,
I think that we may have given you a lot more than you had in mind when you asked your question. I'm aware that you were thinking of "power law" in a way that can be very different than "power dynamics", but I have the latter more on my mind, partially because of recent discussions on Wikimedia-l related to strategy.
I remain interested in knowing what the goal of your research is.
I'll be busy with non-Wikimedia activities for the next few days, but I'll try to get back to the Wikiverse by this Saturday. If you don't hear back from me after about two weeks then please feel free to email me off list if you'd like me to follow up. In the meantime, Kerry and other capable people may be able to help with any further questions regarding your research interests.
Best wishes,
Hi Jan,
The question about steepness of the curve across different projects is indeed fascinating!
You can find my analysis of inequalities in open source software here: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0152976
Best,
Dj
On Wed, Jan 22, 2020, 23:23 Pine W <wiki.pine@gmail.commailto:wiki.pine@gmail.com> wrote: Hi Jan,
I think that we may have given you a lot more than you had in mind when you asked your question. I'm aware that you were thinking of "power law" in a way that can be very different than "power dynamics", but I have the latter more on my mind, partially because of recent discussions on Wikimedia-l related to strategy.
I remain interested in knowing what the goal of your research is.
I'll be busy with non-Wikimedia activities for the next few days, but I'll try to get back to the Wikiverse by this Saturday. If you don't hear back from me after about two weeks then please feel free to email me off list if you'd like me to follow up. In the meantime, Kerry and other capable people may be able to help with any further questions regarding your research interests.
Best wishes,
Pine ( https://meta.wikimedia.org/wiki/User:Pine ) _______________________________________________ Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.orgmailto:Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
I agree that this is an interesting question. We have been working on a few related questions, and I have a few thoughts.
First, inequality of participation can have many causes. In the new communities that I have been looking at, high inequality is often the sign of a dedicated core of contributors, willing to do maintenance and administrative work. In other cases, high inequality may result from newcomers being driven away, for example, or technological constraints that restrict who can contribute. My (untested) guess is that inequality interacts with community age, such that higher inequality is (generally) positive for new/small communities and negative for more established communities.
Rather than trying to directly tie inequality to outcomes, our approach has been to look at measures that are a closer to mechanisms (e.g., our working paper at https://osf.io/preprints/socarxiv/g95pr/, where we look at network measures). Indeed, if you are interested in the influence of technological interventions, it seems like focusing on something like newcomer retention might be more appropriate?
Best, Jeremy
On Thu, Jan 23, 2020 at 7:04 AM Dariusz Jemielniak darekj@alk.edu.pl wrote:
Hi Jan,
The question about steepness of the curve across different projects is indeed fascinating!
You can find my analysis of inequalities in open source software here: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0152976
Best,
Dj
On Wed, Jan 22, 2020, 23:23 Pine W <wiki.pine@gmail.commailto: wiki.pine@gmail.com> wrote: Hi Jan,
I think that we may have given you a lot more than you had in mind when you asked your question. I'm aware that you were thinking of "power law" in a way that can be very different than "power dynamics", but I have the latter more on my mind, partially because of recent discussions on Wikimedia-l related to strategy.
I remain interested in knowing what the goal of your research is.
I'll be busy with non-Wikimedia activities for the next few days, but I'll try to get back to the Wikiverse by this Saturday. If you don't hear back from me after about two weeks then please feel free to email me off list if you'd like me to follow up. In the meantime, Kerry and other capable people may be able to help with any further questions regarding your research interests.
Best wishes,
Pine ( https://meta.wikimedia.org/wiki/User:Pine ) _______________________________________________ Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.orgmailto: Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l _______________________________________________ Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
If anyone was wondering, I was not confusing power law with power dynamics, but Jan's original question talked about community health, redistribution of power and things like training, user friendliness and documentation as strategies, so I assumed power dynamics were in play in the conversation.
The power in Wikipedia is held by administrators and other functionaries, the loudest and most persistent (and most willing to canvass openly or off-wiki) in consensus building and, as I have already argued, in the latitude given to the *mass* of very occasional contributors (whether good faith or bad faith) to do bad or low quality edits which others have to deal with.
If you redefine power in other ways, such as impact (or influence) on readers (those who we serve), then of course the more active users do have the *potential* for that power provided their contributions are made to creating/expanding content rather than fiddling with existing content (most edits are "fiddling"). An occasional contributor has much more limited power wrt to impacting/influence the reader (probably disproportionately lower that their number of edits would suggest as they are more likely to be reverted).
But equally not all very active editors get to shape the reader view. If you look at the activities of the top editors by edit count, they tend to do a lot of very repetitive and arguably more administratively-focused edits with the reorganisation of category system being a major activity. Studies of readers show they don't look much beyond the References and hence aren't looking at the categories so if power is about reader impact/influence, then this group have very little power relative to their number of contributions.
If we talk about community health in Wikipedia (specifically English Wikipedia), we all know it's a massive problem and somewhat independent of power (by any definition). It's an abrasive environment with far more criticism than praise/appreciation across the board. Active contributors regularly burn-outand dealing with "the community" is often given as a reason. While there is always one final issue that is the straw that breaks the camel's back, it's rarely just about that issue but a level of frustration that develops over a long time. Good faith newcomers get turned off by bad initial experiences. Unfortunately this group mean well but often make bad edits. I do outreach to new good-faith contributors in my topic space, but it is a WikiProject Australia message delivered by Twinkle (nobody has time to write personal messages to new contributors each day) but I do try to ask them where they got their information from (failure to cite being a big problem with this group) but rarely do they reply or make further edits.
Jan mentioned training. I also do outreach which is mostly face-to-face edit training and supporting editathons (generally working with a library or university as the partner organisation) so I do a lot of work with new users in face-to-face situations, but for all my efforts (for which the feedback is always very positive), these new users rarely contribute again after these sessions and this experience is common to most people doing outreach work, leading to the belief that "Wikipedians are born not made". There are efforts already taking place to provide online training or on-boarding systems (currently being trialled in some other language Wikipedias) but, even if shown to be effective, I don't think there is much likelihood of mandating any of such things on English Wikipedia with its strong libertarian ideology and most new users are "on a mission" to make a particular change/addition to an article. I don't think most of them will voluntarily do some kind of training or on-boarding first (people on a mission are not easy to deflect in general). I like to believe training in some forms helps individuals but at that end of the power graph the effort/return on individuals is poor. To work with that mass of folk it must be scalable and that tends to rule out anything personal (like a buddy system).
As to user friendliness, there isn't a lot of it on Wikipedia. I recollect someone did a study to see if welcome messages helped improve newcomer retention and found they didn't. Indeed our watchlist/welcome system can easily be perceived by new users as stalking. While a welcome message is intended to be encouraging, it does at the same time send the message "I am watching you" which has been described by some new users who receive welcome messages during my training sessions as "creepy". As someone who sends such messages (via Twinkle, there aren't the hours in the day to welcome new users in a more personal way), some of the responses are "creepy" (clearly they looked at my user account and knew I was a woman and felt it was OK to make some inappropriate remark). There are friendships of course between some users, but you don't come to Wikipedia to make friends (join Facebook). To survive I think you either have to be pretty committed to free knowledge (strong mission alignment) or it rewards in some other way (stroking your ego through edit-count-itis, admin power over others, get to push your POV).
As to documentation, well, ours isn't great. It's hard to find and full of jargon and assumes you know wiki text. And people on a mission won't stop to read it anyway. And frankly as much as I don't like it, I believe my time is better spent researching and writing content than fixing the documentation. Wikipedia is a moving target for documentation in any case as the underlying software is in constant evolution as are various tools, templates, and other things contributors use.
So I think we don't have a healthy community but whether that's related to the power law graph, I am far less convinced. There are a number of quite deliberate choices made on en.WP that create and perpetuate our problems and the community is highly resistant to experiment with these choices. This suggests to me that there are people who get benefit from the current structures, possibly those who are nicknamed the Unblockables, a name that suggests a power dynamic in play!
Kerry
-----Original Message----- From: Wiki-research-l [mailto:wiki-research-l-bounces@lists.wikimedia.org] On Behalf Of Pine W Sent: Thursday, 23 January 2020 2:22 PM To: Wiki Research-l wiki-research-l@lists.wikimedia.org Subject: Re: [Wiki-research-l] Power law and contributions:
Hi Jan,
I think that we may have given you a lot more than you had in mind when you asked your question. I'm aware that you were thinking of "power law" in a way that can be very different than "power dynamics", but I have the latter more on my mind, partially because of recent discussions on Wikimedia-l related to strategy.
I remain interested in knowing what the goal of your research is.
I'll be busy with non-Wikimedia activities for the next few days, but I'll try to get back to the Wikiverse by this Saturday. If you don't hear back from me after about two weeks then please feel free to email me off list if you'd like me to follow up. In the meantime, Kerry and other capable people may be able to help with any further questions regarding your research interests.
Best wishes,
Pine ( https://meta.wikimedia.org/wiki/User:Pine ) _______________________________________________ Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Hello, Thanks for the answers so far. As Pine asked what my interest is: As a Designer and Researcher I co-create features that might have unintended consequences in the long run. Thus I find it important to look at larger patterns.
As for the question why I looked at the edit count: From my own experiences and observations and based on Dariusz’ Ethnography [1] it seems that how many edits someone has is relevant for many editors and that having many edits is seen as good. Also many mass edits are done with “bespoke code” [2] which might have interesting (positive and negative) consequences for editors, since it is neither a matter of user interface nor of immediate personal behaviour (which seem to be frequently discussed as problematic)
As for the question if the edit count distribution is a "good way" to look at how power is distributed in communities: It is but one way to look at it, but given the status that [1] assigns to the edit count and the influence that bespoke code [2] has on it, I think it is worth a look among many other interesting things.
That power (or having many edits) does not equal having a great time (as both Kerry and Pine remarked) and that power is not always explicit (as in Editor-Administrator) is known to me and very relevant (I find this has been well discussed by Jo Freeman [3], too)
My question led to two longer answers and Pine pointed out that "we may have given you a lot more than you had in mind when you asked your question" I am interested if there are reasons why. I am very happy about getting detailed answers but sometimes such answers also hint to concerns of which I am not aware – like the mail which got a bit more detailed due to the impression that looking at edit count distributions and its possible relations to community health might be seen as concerning.
Kind Regards, Jan
PS.: I might be slow in responding.
[1] Jemielniak, Dariusz. 2015. *Common Knowledge?: An Ethnography of Wikipedia*. Reprint. Stanford, Calif: STANFORD UNIV PR, p7, p41: "For a significant portion of the Wikipedia community the number of edits is an important measure of value, often more important than whether a user is an admin. Edit count, even more than participation in community discussion, is perceived as legitimization…" [2] Geiger, R. Stuart. 2014. „Bots, bespoke, code and the materiality of software platforms“. *Information, Communication & Society* 17 (3): 342–56. [3] https://www.jofreeman.com/joreen/tyranny.htm
Am Do., 23. Jan. 2020 um 05:23 Uhr schrieb Pine W wiki.pine@gmail.com:
Hi Jan,
I think that we may have given you a lot more than you had in mind when you asked your question. I'm aware that you were thinking of "power law" in a way that can be very different than "power dynamics", but I have the latter more on my mind, partially because of recent discussions on Wikimedia-l related to strategy.
I remain interested in knowing what the goal of your research is.
I'll be busy with non-Wikimedia activities for the next few days, but I'll try to get back to the Wikiverse by this Saturday. If you don't hear back from me after about two weeks then please feel free to email me off list if you'd like me to follow up. In the meantime, Kerry and other capable people may be able to help with any further questions regarding your research interests.
Best wishes,
Pine ( https://meta.wikimedia.org/wiki/User:Pine ) _______________________________________________ Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
wiki-research-l@lists.wikimedia.org