Hey Nemo,

That's cool that you had that discussion. I didn't know about it.  As you can imagine, I've talked a lot of people about the work myself.  I'm stoked that we're having another discussion right now.  :) 

I'm going to go into scientist-defending-the-value-of-my-work mode for a couple of paragraphs.

Our model did suggest that it is getting more difficult for *all editors* to change policies over time regardless of experience level[1].  It also suggests that this effect is much stronger for new editiors.  I agree that new policy != adaptation.  That's why we modeled change over time for our hypothesis test.  The norm growth graph I referenced is intended to serve as a descriptive visualization. 

It's important to understand that neither of these sets of numbers alone do not tell the whole story here.  Quantitative hypothesis test are narrow windows through which to view the world, yet such tests are used to support or refute complex arguments.  Our argument about the nature of English Wikipedia's decline was built up from current theory and our own qualitative work.  FWIW, more recent research has confirmed some of our basic assumptions(e.g. [2], [3]) and I've re-measured similar phenomena with new metrics several times in the last 3 years. 

An easy counterexample would be finding at least one wiki showing a different pattern in policymaking but equal patterns in everything else.

I'm not sure what you mean by "easy", but I look forward to reading your report.  Seriously though, if you want to work on this, I've got some ideas and I'd be happy to collaborate.
  1. Logistic regression. Page 17, Table 2.  Read the two paragraphs before the table for discussion. 
    http://www-users.cs.umn.edu/~halfak/publications/The_Rise_and_Decline/halfaker13rise-preprint.pdf
  2. http://www.opensym.org/ws2012/p21wikisym2012.pdf
-Aaron



On Thu, Oct 16, 2014 at 6:22 PM, Federico Leva (Nemo) <nemowiki@gmail.com> wrote:
Aaron Halfaker, 16/10/2014 19:40:
I'd argue that the continued persistence of the problems surrounding the
impersonal & negative reception of newcomers is the result of a lack of
adaptability.   Policy calcification (if that's an appropriate term for
the observed trends) is one bit of evidence of decreased capacity for
adaptation.

As a reminder (we already discussed this http://article.gmane.org/gmane.org.wikimedia.foundation/63580 ), it wasn't proved that policies are now harder to change; only that less new policy pages are being created. And only on en.wiki.

Are there other bits of clear evidence for or against this
hypothesis that I'm missing?

An easy counterexample would be finding at least one wiki showing a different pattern in policymaking but equal patterns in everything else.

Nemo


If I'm right, then it is important that we experiment with strategies
for reinforcing/jump-starting Wikipedia's adaptive systems.  One way to
do that is to make it easier for editors to reflect on current trends.
I'd like to think that integrating research practice into wiki culture
(what I've been trying to do with all my work) is one way to do that.
But it would be better if people don't need wait on me and other WMF
researchers to finish a study.  We'd all fare better if access to
research materials was democratized.  That's the reason I am really
excited about projects like quarry.wmflabs.org
<http://quarry.wmflabs.org> (run SQL against Wikipedia's DBs from your
browser).

-Aaron

_______________________________________________
Analytics mailing list
Analytics@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/analytics