(please excuse cross-posting)
Hi everyone!
I posted the latest in the string of program evaluation reports on Meta today, on Wiki Loves Monuments: https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WLM
Highlights of the report include: * About 17% of the images uploaded through Wiki Loves Monuments 2012 are in use on our projects. * The majority of Wiki Loves Monuments participants are new users; however, the survival rate of new users is low (1.7% of the 2012 participants made at least one edit and 1.4% uploaded at least one new file to Commons six months after the event). * Half of the existing editors who participated in Wiki Loves Monuments 2012 also participated in Wiki Loves Monuments 2013, with new users making up for the other half. * The global Wiki Loves Monuments organizing team helps support Wiki Loves Monuments organizers around the world, providing replication opportunities via direct support. This makes it easier for someone to organize their own Wiki Loves Monuments contest.
Questions are welcomed and encouraged on the talk page.
On behalf of the Program Evaluation team,
LiAnna
Thanks! Great to see this summary.
On Fri, Jan 24, 2014 at 6:00 PM, LiAnna Davis ldavis@wikimedia.org wrote:
(please excuse cross-posting)
Hi everyone!
I posted the latest in the string of program evaluation reports on Meta today, on Wiki Loves Monuments: https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WLM
Highlights of the report include:
- About 17% of the images uploaded through Wiki Loves Monuments 2012 are
in use on our projects.
- The majority of Wiki Loves Monuments participants are new users;
however, the survival rate of new users is low (1.7% of the 2012 participants made at least one edit and 1.4% uploaded at least one new file to Commons six months after the event).
- Half of the existing editors who participated in Wiki Loves Monuments
2012 also participated in Wiki Loves Monuments 2013, with new users making up for the other half.
- The global Wiki Loves Monuments organizing team helps support Wiki Loves
Monuments organizers around the world, providing replication opportunities via direct support. This makes it easier for someone to organize their own Wiki Loves Monuments contest.
Questions are welcomed and encouraged on the talk page.
On behalf of the Program Evaluation team,
LiAnna
-- LiAnna Davis Wikipedia Education Program Wikimedia Foundation http://education.wikimedia.org +1-(415) 839-6885 x6649
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
Thanks! The most interesting datum I've noticed so far is the rate of active editor (5+ edits/month) retention among new contributors after six months, which is about 0.4%.
https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WLM#New_u...
That (along with the easy-to-measure and already known sheer quanities of photos generated) seems to me to be the most robust number to use in evaluating WLM (and comparable) funding requests. 0.4% may be considered worthwhile or not enough, depending on local contexts, so I'm not drawing a universal conclusion from it, just noting it.
(just thinking out loud here.)
A.
On Fri, Jan 24, 2014 at 4:14 PM, Samuel Klein meta.sj@gmail.com wrote:
Thanks! Great to see this summary.
On Fri, Jan 24, 2014 at 6:00 PM, LiAnna Davis ldavis@wikimedia.orgwrote:
(please excuse cross-posting)
Hi everyone!
I posted the latest in the string of program evaluation reports on Meta today, on Wiki Loves Monuments: https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WLM
Highlights of the report include:
- About 17% of the images uploaded through Wiki Loves Monuments 2012 are
in use on our projects.
- The majority of Wiki Loves Monuments participants are new users;
however, the survival rate of new users is low (1.7% of the 2012 participants made at least one edit and 1.4% uploaded at least one new file to Commons six months after the event).
- Half of the existing editors who participated in Wiki Loves Monuments
2012 also participated in Wiki Loves Monuments 2013, with new users making up for the other half.
- The global Wiki Loves Monuments organizing team helps support Wiki
Loves Monuments organizers around the world, providing replication opportunities via direct support. This makes it easier for someone to organize their own Wiki Loves Monuments contest.
Questions are welcomed and encouraged on the talk page.
On behalf of the Program Evaluation team,
LiAnna
-- LiAnna Davis Wikipedia Education Program Wikimedia Foundation http://education.wikimedia.org +1-(415) 839-6885 x6649
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
-- Samuel Klein @metasj w:user:sj +1 617 529 4266
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
thanks for this report. and asaf, very true, this is quite impressing and a pleasure to see. even if i would love to see how you calculated this :) more strange to my ears is that 20'000 images would be used on the sites, presented without a reference. lianna, where did you get that number from?
rupert.
On Sat, Jan 25, 2014 at 3:12 AM, Asaf Bartov abartov@wikimedia.org wrote:
Thanks! The most interesting datum I've noticed so far is the rate of active editor (5+ edits/month) retention among new contributors after six months, which is about 0.4%.
https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WLM#New_u...
That (along with the easy-to-measure and already known sheer quanities of photos generated) seems to me to be the most robust number to use in evaluating WLM (and comparable) funding requests. 0.4% may be considered worthwhile or not enough, depending on local contexts, so I'm not drawing a universal conclusion from it, just noting it.
(just thinking out loud here.)
A.
On Fri, Jan 24, 2014 at 4:14 PM, Samuel Klein meta.sj@gmail.com wrote:
Thanks! Great to see this summary.
On Fri, Jan 24, 2014 at 6:00 PM, LiAnna Davis ldavis@wikimedia.orgwrote:
(please excuse cross-posting)
Hi everyone!
I posted the latest in the string of program evaluation reports on Meta today, on Wiki Loves Monuments: https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WLM
Highlights of the report include:
- About 17% of the images uploaded through Wiki Loves Monuments 2012 are
in use on our projects.
- The majority of Wiki Loves Monuments participants are new users;
however, the survival rate of new users is low (1.7% of the 2012 participants made at least one edit and 1.4% uploaded at least one new file to Commons six months after the event).
- Half of the existing editors who participated in Wiki Loves Monuments
2012 also participated in Wiki Loves Monuments 2013, with new users making up for the other half.
- The global Wiki Loves Monuments organizing team helps support Wiki
Loves Monuments organizers around the world, providing replication opportunities via direct support. This makes it easier for someone to organize their own Wiki Loves Monuments contest.
Questions are welcomed and encouraged on the talk page.
On behalf of the Program Evaluation team,
LiAnna
-- LiAnna Davis Wikipedia Education Program Wikimedia Foundation http://education.wikimedia.org +1-(415) 839-6885 x6649
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
-- Samuel Klein @metasj w:user:sj +1 617 529 4266
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
-- Asaf Bartov Wikimedia Foundation http://www.wikimediafoundation.org
Imagine a world in which every single human being can freely share in the sum of all knowledge. Help us make it a reality! https://donate.wikimedia.org
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
On Sat, Jan 25, 2014 at 4:45 AM, rupert THURNER rupert.thurner@gmail.comwrote:
lianna, where did you get that number from?
I want credit for this report to go where it belongs -- the Program
Evaluation team! I'm just assisting with publishing and distributing the report; the work in it is a whole team effort, including contributions from Frank Schulenburg, Dr. Jaime Anstee, Yuan Li, and Edward Galvez. Their hard work went into data collection, reporting, and analysis; I just did some minor copy editing and publicizing. :)
But that being said, I encourage everyone to post comments and questions on the talk page, which is where the program evaluation team will be more likely to see and answer them, rather than having parallel discussions on multiple lists: https://meta.wikimedia.org/wiki/Programs_talk:Evaluation_portal/Library/WLM
LiAnna
On Sat, Jan 25, 2014 at 4:37 PM, LiAnna Davis ldavis@wikimedia.org wrote:
On Sat, Jan 25, 2014 at 4:45 AM, rupert THURNER rupert.thurner@gmail.comwrote:
lianna, where did you get that number from?
I want credit for this report to go where it belongs -- the Program
Evaluation team! I'm just assisting with publishing and distributing the report; the work in it is a whole team effort, including contributions from Frank Schulenburg, Dr. Jaime Anstee, Yuan Li, and Edward Galvez. Their hard work went into data collection, reporting, and analysis; I just did some minor copy editing and publicizing. :)
But that being said, I encourage everyone to post comments and questions on the talk page, which is where the program evaluation team will be more likely to see and answer them, rather than having parallel discussions on multiple lists: https://meta.wikimedia.org/wiki/Programs_talk:Evaluation_portal/Library/WLM
oh, my english is bad, i of course ment how you calculated the number.
there must be some tools available to do this, and ideally they are online for everybody. 60'000 images used is such an impressive number ... it still leaves me speachless :)
rupert.
2014-01-25 rupert THURNER rupert.thurner@gmail.com:
On Sat, Jan 25, 2014 at 4:37 PM, LiAnna Davis ldavis@wikimedia.org wrote:
On Sat, Jan 25, 2014 at 4:45 AM, rupert THURNER rupert.thurner@gmail.comwrote:
lianna, where did you get that number from?
I want credit for this report to go where it belongs -- the Program
Evaluation team! I'm just assisting with publishing and distributing the report; the work in it is a whole team effort, including contributions from Frank Schulenburg, Dr. Jaime Anstee, Yuan Li, and Edward Galvez. Their hard work went into data collection, reporting, and analysis; I just did some minor copy editing and publicizing. :)
But that being said, I encourage everyone to post comments and questions on the talk page, which is where the program evaluation team will be more likely to see and answer them, rather than having parallel discussions on multiple lists: https://meta.wikimedia.org/wiki/Programs_talk:Evaluation_portal/Library/WLM
oh, my english is bad, i of course ment how you calculated the number.
there must be some tools available to do this, and ideally they are online for everybody. 60'000 images used is such an impressive number ... it still leaves me speachless :)
Do you mean the number of images? You might like to analyse the stats page: https://toolserver.org/~emijrp/wlm/stats.php
It might not match 100% what the report says, as some images were deleted, but it should be pretty close. You also have raw data if you want to make your own statistics.
I appreciate the effort and time that went into this. Thanks for that.
It presents a few interesting questions, while I think there are some footnotes to place too (for example, as far as I can see the 'retention' has only been measured for Wikimedia Commons, and is therefore lower than the numbers that I recall from earlier reports by Erik Zachte). I'm also not sure if I agree with the suggestions used sometimes ('low' etc) - but that is probably in part a matter of expectations and definitions.
However, I haven't spent a lot of time reading through this heap of text - first things first, including a proper finishing & evaluation for WLM 2013 that is overdue :)
Best, Lodewijk
2014/1/25 Asaf Bartov abartov@wikimedia.org
Thanks! The most interesting datum I've noticed so far is the rate of active editor (5+ edits/month) retention among new contributors after six months, which is about 0.4%.
https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WLM#New_u...
That (along with the easy-to-measure and already known sheer quanities of photos generated) seems to me to be the most robust number to use in evaluating WLM (and comparable) funding requests. 0.4% may be considered worthwhile or not enough, depending on local contexts, so I'm not drawing a universal conclusion from it, just noting it.
(just thinking out loud here.)
A.
On Fri, Jan 24, 2014 at 4:14 PM, Samuel Klein meta.sj@gmail.com wrote:
Thanks! Great to see this summary.
On Fri, Jan 24, 2014 at 6:00 PM, LiAnna Davis ldavis@wikimedia.orgwrote:
(please excuse cross-posting)
Hi everyone!
I posted the latest in the string of program evaluation reports on Meta today, on Wiki Loves Monuments: https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WLM
Highlights of the report include:
- About 17% of the images uploaded through Wiki Loves Monuments 2012 are
in use on our projects.
- The majority of Wiki Loves Monuments participants are new users;
however, the survival rate of new users is low (1.7% of the 2012 participants made at least one edit and 1.4% uploaded at least one new file to Commons six months after the event).
- Half of the existing editors who participated in Wiki Loves Monuments
2012 also participated in Wiki Loves Monuments 2013, with new users making up for the other half.
- The global Wiki Loves Monuments organizing team helps support Wiki
Loves Monuments organizers around the world, providing replication opportunities via direct support. This makes it easier for someone to organize their own Wiki Loves Monuments contest.
Questions are welcomed and encouraged on the talk page.
On behalf of the Program Evaluation team,
LiAnna
-- LiAnna Davis Wikipedia Education Program Wikimedia Foundation http://education.wikimedia.org +1-(415) 839-6885 x6649
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
-- Samuel Klein @metasj w:user:sj +1 617 529 4266
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
-- Asaf Bartov Wikimedia Foundation http://www.wikimediafoundation.org
Imagine a world in which every single human being can freely share in the sum of all knowledge. Help us make it a reality! https://donate.wikimedia.org
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
Asaf Bartov, 25/01/2014 03:12:
Thanks! The most interesting datum I've noticed so far is the rate of active editor (5+ edits/month) retention among new contributors after six months, which is about 0.4%.
Is "active editor retention" a metric defined somewhere? It's not in https://meta.wikimedia.org/wiki/Category:WMF_standardized_editor_classes.
https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WLM#New_u...
That (along with the easy-to-measure and already known sheer quanities of photos generated) seems to me to be the most robust number to use in evaluating WLM (and comparable) funding requests. 0.4% may be considered worthwhile or not enough, depending on local contexts, so I'm not drawing a universal conclusion from it, just noting it.
See http://www.wikilovesmonuments.org/wiki-loves-monuments-footprint/ for more.
Nemo
On Sat, Jan 25, 2014 at 6:10 AM, Federico Leva (Nemo) nemowiki@gmail.comwrote:
Asaf Bartov, 25/01/2014 03:12:
Thanks! The most interesting datum I've noticed so far is the rate of
active editor (5+ edits/month) retention among new contributors after six months, which is about 0.4%.
Is "active editor retention" a metric defined somewhere? It's not in https://meta.wikimedia.org/wiki/Category:WMF_ standardized_editor_classes.
I guess it isn't, and it seems to me it should be. But I'm not a researcher, and I leave it to the research community to figure out if this is an interesting metric for them. I can tell you it's an interesting metric to _me_, because making 1 edit some time within six months of registration is _much_ less meaningful than making at least 5 edits a month (which is the active editor definition).
(I note that https://meta.wikimedia.org/wiki/Research:Active_editor is not in the above category, and is also not defined on Meta. Once again, I'm not taking it upon myself to fix those pages, as I feel they are !owned by others. But it behooves us to get these a little more aligned. CCing Dario and crossing my fingers.
Asaf
wikilovesmonuments@lists.wikimedia.org