New Program Evaluation report: Wiki Loves Monuments - WikiLovesMonuments

Samuel Klein

25 Jan 25 Jan

12:14 a.m.

New subject: New Program Evaluation report: Wiki Loves Monuments

Thanks! Great to see this summary. On Fri, Jan 24, 2014 at 6:00 PM, LiAnna Davis <ldavis(a)wikimedia.org> wrote:

(please excuse cross-posting) Hi everyone! I posted the latest in the string of program evaluation reports on Meta today, on Wiki Loves Monuments: https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WLM Highlights of the report include: * About 17% of the images uploaded through Wiki Loves Monuments 2012 are in use on our projects. * The majority of Wiki Loves Monuments participants are new users; however, the survival rate of new users is low (1.7% of the 2012 participants made at least one edit and 1.4% uploaded at least one new file to Commons six months after the event). * Half of the existing editors who participated in Wiki Loves Monuments 2012 also participated in Wiki Loves Monuments 2013, with new users making up for the other half. * The global Wiki Loves Monuments organizing team helps support Wiki Loves Monuments organizers around the world, providing replication opportunities via direct support. This makes it easier for someone to organize their own Wiki Loves Monuments contest. Questions are welcomed and encouraged on the talk page. On behalf of the Program Evaluation team, LiAnna -- LiAnna Davis Wikipedia Education Program Wikimedia Foundation http://education.wikimedia.org +1-(415) 839-6885 x6649 _______________________________________________ Wiki Loves Monuments mailing list WikiLovesMonuments(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org

-- Samuel Klein @metasj w:user:sj +1 617 529 4266

Reply

rupert THURNER

12:45 p.m.

New subject: New Program Evaluation report: Wiki Loves Monuments

thanks for this report. and asaf, very true, this is quite impressing and a pleasure to see. even if i would love to see how you calculated this :) more strange to my ears is that 20'000 images would be used on the sites, presented without a reference. lianna, where did you get that number from? rupert. On Sat, Jan 25, 2014 at 3:12 AM, Asaf Bartov <abartov(a)wikimedia.org> wrote:

...

Thanks! The most interesting datum I've noticed so far is the rate of active editor (5+ edits/month) retention among new contributors after six months, which is about 0.4%. https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WLM#New_… That (along with the easy-to-measure and already known sheer quanities of photos generated) seems to me to be the most robust number to use in evaluating WLM (and comparable) funding requests. 0.4% may be considered worthwhile or not enough, depending on local contexts, so I'm not drawing a universal conclusion from it, just noting it. (just thinking out loud here.) A. On Fri, Jan 24, 2014 at 4:14 PM, Samuel Klein <meta.sj(a)gmail.com> wrote:

Thanks! Great to see this summary. On Fri, Jan 24, 2014 at 6:00 PM, LiAnna Davis <ldavis(a)wikimedia.org>wrote;wrote:

(please excuse cross-posting) Hi everyone! I posted the latest in the string of program evaluation reports on Meta today, on Wiki Loves Monuments: https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WLM Highlights of the report include: * About 17% of the images uploaded through Wiki Loves Monuments 2012 are in use on our projects. * The majority of Wiki Loves Monuments participants are new users; however, the survival rate of new users is low (1.7% of the 2012 participants made at least one edit and 1.4% uploaded at least one new file to Commons six months after the event). * Half of the existing editors who participated in Wiki Loves Monuments 2012 also participated in Wiki Loves Monuments 2013, with new users making up for the other half. * The global Wiki Loves Monuments organizing team helps support Wiki Loves Monuments organizers around the world, providing replication opportunities via direct support. This makes it easier for someone to organize their own Wiki Loves Monuments contest. Questions are welcomed and encouraged on the talk page. On behalf of the Program Evaluation team, LiAnna -- LiAnna Davis Wikipedia Education Program Wikimedia Foundation http://education.wikimedia.org +1-(415) 839-6885 x6649 _______________________________________________ Wiki Loves Monuments mailing list WikiLovesMonuments(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org

-- Samuel Klein @metasj w:user:sj +1 617 529 4266 _______________________________________________ Wiki Loves Monuments mailing list WikiLovesMonuments(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org

-- Asaf Bartov Wikimedia Foundation <http://www.wikimediafoundation.org> Imagine a world in which every single human being can freely share in the sum of all knowledge. Help us make it a reality! https://donate.wikimedia.org _______________________________________________ Wiki Loves Monuments mailing list WikiLovesMonuments(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org

Reply

rupert THURNER

4:18 p.m.

New subject: New Program Evaluation report: Wiki Loves Monuments

On Sat, Jan 25, 2014 at 4:37 PM, LiAnna Davis <ldavis(a)wikimedia.org> wrote:

...

On Sat, Jan 25, 2014 at 4:45 AM, rupert THURNER <rupert.thurner(a)gmail.com>wrote;wrote:

lianna, where did you get that number from? I want credit for this report to go where it belongs -- the Program

Evaluation team! I'm just assisting with publishing and distributing the report; the work in it is a whole team effort, including contributions from Frank Schulenburg, Dr. Jaime Anstee, Yuan Li, and Edward Galvez. Their hard work went into data collection, reporting, and analysis; I just did some minor copy editing and publicizing. :) But that being said, I encourage everyone to post comments and questions on the talk page, which is where the program evaluation team will be more likely to see and answer them, rather than having parallel discussions on multiple lists: https://meta.wikimedia.org/wiki/Programs_talk:Evaluation_portal/Library/WLM oh, my english is bad, i of course ment how you calculated the number.

there must be some tools available to do this, and ideally they are online for everybody. 60'000 images used is such an impressive number ... it still leaves me speachless :) rupert.

Reply

Lodewijk

1:40 p.m.

New subject: New Program Evaluation report: Wiki Loves Monuments

I appreciate the effort and time that went into this. Thanks for that. It presents a few interesting questions, while I think there are some footnotes to place too (for example, as far as I can see the 'retention' has only been measured for Wikimedia Commons, and is therefore lower than the numbers that I recall from earlier reports by Erik Zachte). I'm also not sure if I agree with the suggestions used sometimes ('low' etc) - but that is probably in part a matter of expectations and definitions. However, I haven't spent a lot of time reading through this heap of text - first things first, including a proper finishing & evaluation for WLM 2013 that is overdue :) Best, Lodewijk 2014/1/25 Asaf Bartov <abartov(a)wikimedia.org>

...

Thanks! The most interesting datum I've noticed so far is the rate of active editor (5+ edits/month) retention among new contributors after six months, which is about 0.4%. https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WLM#New_… That (along with the easy-to-measure and already known sheer quanities of photos generated) seems to me to be the most robust number to use in evaluating WLM (and comparable) funding requests. 0.4% may be considered worthwhile or not enough, depending on local contexts, so I'm not drawing a universal conclusion from it, just noting it. (just thinking out loud here.) A. On Fri, Jan 24, 2014 at 4:14 PM, Samuel Klein <meta.sj(a)gmail.com> wrote:

Thanks! Great to see this summary. On Fri, Jan 24, 2014 at 6:00 PM, LiAnna Davis <ldavis(a)wikimedia.org>wrote;wrote:

(please excuse cross-posting) Hi everyone! I posted the latest in the string of program evaluation reports on Meta today, on Wiki Loves Monuments: https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WLM Highlights of the report include: * About 17% of the images uploaded through Wiki Loves Monuments 2012 are in use on our projects. * The majority of Wiki Loves Monuments participants are new users; however, the survival rate of new users is low (1.7% of the 2012 participants made at least one edit and 1.4% uploaded at least one new file to Commons six months after the event). * Half of the existing editors who participated in Wiki Loves Monuments 2012 also participated in Wiki Loves Monuments 2013, with new users making up for the other half. * The global Wiki Loves Monuments organizing team helps support Wiki Loves Monuments organizers around the world, providing replication opportunities via direct support. This makes it easier for someone to organize their own Wiki Loves Monuments contest. Questions are welcomed and encouraged on the talk page. On behalf of the Program Evaluation team, LiAnna -- LiAnna Davis Wikipedia Education Program Wikimedia Foundation http://education.wikimedia.org +1-(415) 839-6885 x6649 _______________________________________________ Wiki Loves Monuments mailing list WikiLovesMonuments(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org

-- Samuel Klein @metasj w:user:sj +1 617 529 4266 _______________________________________________ Wiki Loves Monuments mailing list WikiLovesMonuments(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org

-- Asaf Bartov Wikimedia Foundation <http://www.wikimediafoundation.org> Imagine a world in which every single human being can freely share in the sum of all knowledge. Help us make it a reality! https://donate.wikimedia.org _______________________________________________ Wiki Loves Monuments mailing list WikiLovesMonuments(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org

Reply

Asaf Bartov

27 Jan 27 Jan

7:55 p.m.

New subject: New Program Evaluation report: Wiki Loves Monuments

On Sat, Jan 25, 2014 at 6:10 AM, Federico Leva (Nemo) <nemowiki(a)gmail.com>wrote;wrote:

...

Asaf Bartov, 25/01/2014 03:12: Thanks! The most interesting datum I've noticed so far is the rate of

active editor (5+ edits/month) retention among new contributors after six months, which is about 0.4%.

Is "active editor retention" a metric defined somewhere? It's not in <https://meta.wikimedia.org/wiki/Category:WMF_ standardized_editor_classes>.

I guess it isn't, and it seems to me it should be. But I'm not a researcher, and I leave it to the research community to figure out if this is an interesting metric for them. I can tell you it's an interesting metric to _me_, because making 1 edit some time within six months of registration is _much_ less meaningful than making at least 5 edits a month (which is the active editor definition). (I note that https://meta.wikimedia.org/wiki/Research:Active_editor is not in the above category, and is also not defined on Meta. Once again, I'm not taking it upon myself to fix those pages, as I feel they are !owned by others. But it behooves us to get these a little more aligned. CCing Dario and crossing my fingers. Asaf -- Asaf Bartov Wikimedia Foundation <http://www.wikimediafoundation.org> Imagine a world in which every single human being can freely share in the sum of all knowledge. Help us make it a reality! https://donate.wikimedia.org

Reply