Hi Rui,
You raised a lot of questions that I think I might be able to help address. I'm a research scientist working for the WMF. My research focuses on the nature of newcomer participation, editor motivation and value production in Wikipedia. See [1] and [2] (if you have the time) for my most seminal work on the subject.
As you'll see in the study I referenced, my work directly addresses a substantial portion of the questions you've raised. See also my team's work with standardizing metrics[3] including survival measures[4] and my work exploring retention trends in ptwiki[5]. See [6] for an example of a recent, cross-language study of newcomer article creation patterns. Also, you might be interested in [7] since it confirms your general concerns about the speed of speedy deletions.
A lot of the work of /really understanding Wikipedia/ is only half-way done since it takes a long time build understanding about previously undocumented phenomena. The academic community, other researchers at the WMF and myself are in the middle of developing a whole field around how open collaboration systems like Wikipedia work, common problems they have and how they can be best supported.
While we're developing this general knowledge about engagement, production and retention in our communities, we (the research & data team) are also working directly with product teams at the WMF to measure their impact on key metrics (e.g. participation) with scientific rigor and to challenge/develop/refine theory on which product strategies lead us toward our goals and which ones do not. See [8] and [9] for examples of such studies.
I welcome anyone who'd like to continue the conversation about what we do and don't know about Wikipedia(s) to raise discussions at wiki-research-l[10]. There are a lot more researchers on that list than wikimedia-l. FWIW, I tend to follow that list more closely.
1. Summary: http://www-users.cs.umn.edu/~halfak/publications/The_Rise_and_Decline/ 2. Full paper: http://www-users.cs.umn.edu/~halfak/publications/The_Rise_and_Decline/halfak... 3. https://www.mediawiki.org/wiki/Analytics/Editor_Engagement_Vital_Signs 4. https://meta.wikimedia.org/wiki/Research:Surviving_new_editor 5. https://meta.wikimedia.org/wiki/Research:Ideas/Is_ptwiki_declining_like_enwi... 6. https://meta.wikimedia.org/wiki/Research:Wikipedia_article_creation 7. https://meta.wikimedia.org/wiki/Research:The_Speed_of_Speedy_Deletions 8. https://meta.wikimedia.org/wiki/Research:Onboarding_new_Wikipedians/Rollout 9. https://meta.wikimedia.org/wiki/Research:VisualEditor%27s_effect_on_newly_re... 10. https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
-Aaron
From: Rui Correia correia.rui@gmail.com Subject: Re: [Wikimedia-l] The first three weeks. Date: May 29, 2014 at 5:07:45 AM PDT To: Wikimedia Mailing List wikimedia-l@lists.wikimedia.org Reply-To: Wikimedia Mailing List wikimedia-l@lists.wikimedia.org
Hi James
Do we have any figures on retention of new editors? How long does the average new editor stay? What percentage of new editors stays on for 6 months; one year; two years? Do we have these figures for all languages?
New editors should be allowed space to grow. Wikipedia is so rich in developing all kinds of scripts, templates etc, that it would be easy to create something to inform others that someone is a new editor. Pages by new editors should be left alone for a day or two. There is nothing more disheartening than getting all excited about contributing only to find
that
someone comes along and either deletes your first attempt or nominates it for deletion. I've have seen this happen WITHIN MINUTES of the seminal version being posted, followed up by 'warnings' on the editor's talk
page.
I've seen edits reverted because the formatting of the source was wrong.
It
should be a basic pillar that before reverting, we see if we can improve/ fix the problem. Undoing a newcomer's work and leaving something like WP:MOS as an edit summary is not helpful - if you are going to cite a WP policy, then do so by pointing directly to the specific page where the
new
editor can read about it. I know it is time-consuming to fill in edit summaries, especially if one is doing a series of identical edits to a whole lot of pages. But we can use technology to speed this up - on a
blank
edit summary, a prompt will suggest earlier text and you can select an applicable one. On an edit summary with a reference to the section of the page this does not work - so we need to find a way around this, like splitting the field.
No amount of ink about how welcoming WP is to new editors, IT IS NOT. For reference, this section has some interesting facts, https://en.wikipedia.org/wiki/Wikipedia#Contributors.
We are also losing established editors, mostly because of edit warring. There are blocks coalescing around all kinds of themes and issues and
these
defend their turf.
Pages that contain controversial details should display a specific
notice -
not difficult to do, given the array of templates already in use. Some pages are the result of a compromise reached after acrimonious debate. An editor - old or new - who was not involved in discussions will not know this and might make an edit that detonates the powder keg and starts the war all over again. It would be so easy to display a notice on the EDIT PAGE saying something like "Hi, if you were planning to edit .....[ x detail] ... please read (link) the discussion and resolution on this. I
am
pretty convinced it would work far better than having thousands of pages locked ([semi-]protected). Some pages just require a simple message on
the
EDIT PAGE such as (example) "In the English Wikipedia we use the spelling *Braganza* and not *Bragança* when referring to the House of Braganza. Please do not change this.". There are 1,300 pages where Braganza is mentioned, imagine how many headaches we could spare ourselves.
Some editors seem to derive pleasure from the constant reverting/ protecting - you soon get to know who the 'group' is and can read on
their
talk pages comments and jokes about a "here we go again" scenario. It is
as
if they actually lie in wait for the next unwary editor to come along and make a change.
At the same time, there are hundreds of thousands of pages that do not
meet
20% of the quality criteria and nobody does anything to remedy them. Yet, do something like move the page, change the infobox and immediately the 'owners' come out of the woodwork to revert.
Someone cited Ukranian in this thread and I would like to pick up on
that.
There is a tendency at the higher levels to equate Wikipedia with the English Wikipedia and all else are something else. This includes the
level
of involvement by the Foundation etc in the non-English Wikipedias, often with the justification (excuse?) that each is independent. And of course each language WP will use this independence to its advantage when convenient, as a reason why this or that is being done differently. In
the
same breath, content that is specifically marked as referring to the
En-WP
is then regurgitated as if it reflects the whole WP, as here, in the Portuguese WP:
https://pt.wikipedia.org/wiki/Confiabilidade_da_Wikip%C3%A9dia#Avalia.C3.A7....
Independence is well and good, but not when for example the Portuguese WP votes/ debates/ discusses/ relaxing sourcing policies. If WP is to be judged on its reliability then on a number of key elements it must be
held
to one standard with criteria that apply across the board. We can't have different standards on reliability of sources, notibality, etc.
To shrug it off as an issue of the Portuguese WP is to bury our heads in the sand, to shirk responsibility, because such issues are symptomatic of the problems facing the WP as a whole and contributing to the reasons
that
make editors pack up and go.
Also from Portuguese WP, it is embarassing that since 2009 there have
been
all kinds of processes to arrive at a solution for what to call pages on animals and plants - eg: cattle/ bull/ ox/ cow/ bos ... By the looks of
it,
[[Cattle]] in the English WP has been locked for years for the same
reason.
This kind of thing snowballs and then other aspects come into play, overflow and contaminate other areas of the WP as if by contagion.
James, from the link you provided, I see a reference to bias. We all have our 'usual beats' but we all also edit anywhere where we might happen to find something wrong. In doing that, you soon find out that just about
each
page has 'owners', usually 3 or 4 and these work as a team to preserve their way of seeing it. Very worrying is that a lot of this happens on pages on big corporations, which raises the spectre of the possibility (already proven) of 'editors' working for money. Equally nefarious, I
have
noted a group of editos (5 or 6, plus socks [some exposed, others suspected] and countless IP accounts) who are active on a few hundred
pages
deleting/ sanitising negative references to CIA/ US (and 'allies') involvement in right-wing coups all over the world and generally anything unsavoury about the US in all pages on conflicts in which the US has
taken
part.
In my experience, resolution mechanims for situations such as any that
fit
any of the cases above tend to favour the status quo. I have investigates some of these cases and it is quite apparent that in many cases the
'admin'
taking a decision is also part of group that is trying to defend a
certain
point of view.
Finally, I think it is time to think seriously and hard about anonymous (IP) editing. We can all be anonymous, so with a username you are not
less
so. I do believe that IPs who make a few edits here and there, often unconstructive, would stop if they were not serious and do not want to bother registering. Conversely, one you register, it is as if you become officially a member. It is unlikely that one would bother registering and then engage in vandalism and unconstructive editing.
Best regards,
Rui