Hello my friends,
I didn't have the opportunity to organize a WLM contest yet, but I had the opportunity to organize the Brazilian WLE last year and I'm promoting that same contest here in Brasil this year again.
Quantitative analysis are always easier to do than qualitative analysis. In that case WMF is always trying to show how the money was spent, how much and the direct impact of that effort.
So, basically we are always measuring using metrics of the conversion of money/time to edits/new users engagement and retention.
IMHO, WLE and WLM are bigger than this and these projects are very complex with many types of results and direct and mainly, indirect impacts to the Wikimedia Projects and movement in general.
By example, last year we organized an exhibition https://pt.wikipedia.org/wiki/Wikip%C3%A9dia:Wiki_Loves_Earth_2014/Brasil/Ex... with the TOP500 photos collected during the WLE Brasil 2014. So, during that exhibition so many people from many classes, ages, cities and level of knowledge passed by the exhibition and read the contest descriptions and they got more information regarding the Photo Contest, WLE, Wikipedia, Commons and the Wikimedia movement. Since we can't track the visitors behavior after the exhibition, we cant say anything regarding the results of that activity based on the regular metrics, used by default. So, based in things like that we cant publish any final report with the real impact of the exhibition translated in some numbers.IMHO that report regarding WLM don't reflect the real impact of the contest, we can see there only some simple numbers and conversions and this kind of report can generate a lot of misunderstanding when accessed by the regular media.
Best regards
Rodrigo Padula Wikimedia Brazilian Group of Education and Research PPGI/UFRJ
2015-05-06 10:59 GMT-03:00 Claudia Garád claudia.garad@wikimedia.at:
Hi Sam,
I am sure there are figures and stories that the various orgs collect and publish. But they are spread across different wikis and websites and/or languages. E.g. many of the FDC orgs are looking into ways to demonstrate these more qualitative aspects of our work (e.g. by storytelling) in their reports. But these information does not get the same attention and publicity in the wider community as the evaluation done by the WMF. Many WMAT volunteers and I myself share the concerns expressed by Romaine that these unidimensional numbers and lack of context foster misconceptions or even prejudices especially in the parts of the community that are not closely involved in the work of the respective groups and orgs.
Best Claudia
Am 06.05.2015 um 13:40 schrieb Sam Klein:
Hi Romaine,
Are there other evals of WLM projects that capture the complexity you want?
Perhaps single-community evaluations done by the WLM organizers there?
Sam
On Wed, May 6, 2015 at 7:21 AM, Romaine Wiki romaine.wiki@gmail.com wrote:
Hi all,
In the past months the Wikimedia Foundation has been writing an evaluation about Wiki Loves Monuments. [1]
At such it is fine that WMF is writing an evaluation, however they fail in actual understanding Wiki Loves Monuments, and that is shown in the evaluation report.
As a result on the Wiki Loves Monuments mailing list a discussion grows about the various problems the evaluation has.
As the Learning and Evaluation team at the Wikimedia Foundation already had released the first Programs Reports for Wiki Loves Monuments, we are now put as fait accompli with this evaluation report.
Therefore I am writing here so that the rest of the worldwide Wikimedia community is informed that this is not going right.
Wiki Loves Monuments is not just a bunch of uploads done in September, the report is too simplified without actual understanding how the community is doing this project.
Romaine
[1]
https://meta.wikimedia.org/wiki/Grants:Evaluation/Evaluation_reports/2015/Wi... _______________________________________________ Wikimedia-l mailing list, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-request@lists.wikimedia.org?subject=unsubscribe
Wikimedia-l mailing list, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-request@lists.wikimedia.org?subject=unsubscribe