Greetings Program Leaders and Evaluators!
Important updates from Learning and Evaluation:
== New blog! Quantitative vs Qualitative: More friends than enemies [1] ==
The post, that can be found on the Wikimedia blog [1], gives a general
overview on this two methods for gathering information and doing
evaluation. In the context of the II Round of Data collection around
Wikimedia programs, and as we put into effect Global Metrics, this resource
will come in especially handy for program leaders.
The new page on the Evaluation portal [2] has more information on the
original divide between the two, the theoretical origin they stem from and
how they can be combined in a mixed-method world to tell better stories
about programs.
== New Resource! Measures for Evaluation [3] ==
Because global metrics is a short list of measures for measuring program
goals, the new tool Measures for Evaluation [3], provides several maps for
planning out your evaluation journey! The tool is organized through three
strategic priorities: (1) Increase Participation, (2) Add Quality Content,
and (3) Expand Reach and Readership. Most importantly, use the talk page to
suggest measures and tools where you might not see any!
== New blog! Global Metrics for Grants [4] ==
Last week we published a blogpost about Global Metrics, that explains the
origin of this new set of metrics and we hope to learn from them as a
movement. Most importantly, it describes how they are linked to the impact
analysis the Learning and Evaluation team has shared in the past months,
and how to tell a more complete story that goes beyond the numbers. If you
haven’t seen them yet, please find the Learning Patterns that go over each
metric on the Evaluation Portal [5]. Please reach out to us if you have any
questions!
== Second Round of Data collection has launched. Join us! [6]==
Last Tuesday we sent around an invite to program leaders to take part in
the second round of data collection and analysis of Wikimedia programs.
This week, the invite was extended to the movement via the general
Wikimedia list. With your help, we hope to gather the data we need to build
a better understanding of Wikimedia programs and projects. Please note you
can submit your own reports in any language.
As always, stay up-to-date by connecting on our portal [7].
On behalf of the Program Evaluation and Design team, thank you for your
time and attention.
*María Cruz * \\ Community Coordinator, PE&D Team \\ Wikimedia Foundation,
Inc.
mcruz(a)wikimedia.org | : @marianarra_ <https://twitter.com/marianarra_>
[1] Quantitative vs Qualitative - Blog:
http://blog.wikimedia.org/2014/09/24/quantitative-versus-qualitative-more-f…
[2] Quantitative vs Qualitative - Page:
https://meta.wikimedia.org/wiki/Grants:Evaluation/Quantitative_vs_Qualitati…
[3] Measures for Evaluation:
https://meta.wikimedia.org/wiki/Grants:Evaluation/Measures_for_evaluation
[4] Global Metrics for Grants: one way of doing, reporting and learning
better (blog):
http://blog.wikimedia.org/2014/09/16/global-metrics-for-grants-one-way-of-d…
[5] Learning Patterns for Global Metrics on the Evaluation Portal:
https://meta.wikimedia.org/wiki/Grants:Learning_patterns/Calculating_global…
[6] Round II of Data Reporting doc:
https://docs.google.com/a/wikimedia.org/document/d/1CG-K8I1d9JPqyRRyHTIQ5x7…
[7] Upcoming Events Section in PE&D portal:
https://meta.wikimedia.org/wiki/Grants:Evaluation/News#upcoming-events
Dear Program Leaders and Evaluators,
Today, we launch our second round of voluntary reporting. We invite all
program leaders and evaluators to participate in, the most epic data
collection and analysis of Wikimedia programs we've done so far as a
movement.
As we did in the Fall of 2013, once again we cordially request for you to
share the data you have been collecting to evaluate your programs
(i.e., Edit-a-thons,
Editing Workshops, On-wiki Writing Contests, Photo Events, etc.). To best
prepare, review the reporting items *[1]* and start gathering that data you
have filed away about your programs since September 1, 2013! You can ask
questions directly on the reporting form preview or on our portal talk page
[2]. When you are ready to begin, you will find the reporting collector at:
https://wikimedia.qualtrics.com/SE/?SID=SV_0B3azKpdZ7ggCtD
Last year, we were honored to have so many program leaders willing to
report whatever data they could. Many have benefitted from those first
reports *[3]*. We know everyone has been tracking and collecting more than
ever before and we are excited for this second round. We will be looking
for your reports and reaching out to offer support in reporting; if you are
planning to report, let us know so that we can help best. Have you been
tracking these data in a different way that you would like to share with
us, or have you already reported these data elsewhere? No problem, we are
happy to have you share in another format. Message eval(a)wikimedia.org and
we can work out the easiest way to include your data!
We are expanding the number of programs covered in the reporting this year,
and extend the reporting window longer for some new programs, GLAM, and
Wiki Loves Monuments. See the schedule below for timelines for reporting for
each program type.
Data submission deadlines by program:
Data due by October 20th
-
Edit-a-thons
-
Editing Workshops
Data due by November 3rd
-
On-wiki Writing Contests
-
Photo Events (Wiki Loves Earth, WikiExpeditions, WikiTakes, et.)
-
Wikipedia Education Program
Data due by November 17th
-
Conferences
-
GLAM Content Donation
-
Hackathons
-
Wiki Loves Monuments
-
Wikimedian in Residence
Remember, reporting is voluntary but the more people do it, the better
representation of programs we can make. This voluntary reporting allows us
to come together and generate a bird’s eye view of programs *[4]*. We want
to understand the impact of programs across different contexts, to examine
both more broadly, and more deeply, what works best to meet our shared
goals for Wikimedia and to, together, grow the awesome *[5]* in Wikimedia
programs!
On behalf of the Program Evaluation and Design team, thank you for your
time and support in this initiative.
*María Cruz * \\ Community Coordinator, PE&D Team \\ Wikimedia Foundation,
Inc.
mcruz(a)wikimedia.org | : @marianarra_ <https://twitter.com/marianarra_>
*Resource links:*
*[1]*
https://docs.google.com/document/d/1CG-K8I1d9JPqyRRyHTIQ5x7fASQXcHZsEMKutdA…
*[2]* https://meta.wikimedia.org/wiki/Grants_talk:Evaluation
*[3] *
https://meta.wikimedia.org/wiki/Grants:Evaluation/Evaluation_reports/2013
*[4]*
https://commons.wikimedia.org/wiki/File:Evaluation_Report_(beta)_Poster_Wik…
*[5]* http://www.nbp.org/nbp/images/book_photos/MAG-AWESOME.jpg
Greetings Program Leaders and Evaluators!
Important updates from Learning and Evaluation:
== Introducing Global Metrics [1] in all WMF reports ==
Starting on September this year, we are going to put into effect a series
of Global Metrics [1], that will help all parties involved understand the
work being done through donors money. These will have the form of a table
template that will be included in the reporting form. Grant officers,
grantees and grant committee members have already been notified of these
changes, and discussions were held on IRC on Thursday, September 4 and
September 11. A coming blogpost on the Wikimedia blog will be available
next week with more information. We have also developed a set of Learning
Patterns for all seven metrics available on the Evaluation Portal [2].
== Second Round of Data collection coming soon ==
Next week our team will be sending out a call for voluntary submission for
the second round of data collection. Previous data collection has allowed
us to generate the first Program Reports (beta) [3]. Join us in learning
and understanding Wikimedia programs!
== Setting Goals and Targets with a SMART criteria [4] ==
If you missed the virtual event, it is now available online [4]. The event,
that took place on September 4, was followed by Office Hours on September
10. The virtual meet-up focused on using a SMART criteria to set goals and
targets, with a focus on writing the Annual Plan proposal for the FDC.
Visit the available resources on the Evaluation Portal [5] and reach out to
the team for further questions!
== Upcoming event: Wikimetrics Overview [6] ==
On Wednesday, September 17 at 1500 UTC, we will host a new virtual event to
showcase Wikimetrics. This tool has two new features: newly registered
users, and editor survival threshold. The team will go over the tool step
by step and will also enable two office hours of consultation via IRC
channel #wikimedia-ped. Bring your user cohort and take active part in the
event [6] !
== Ongoing question on the portal: the origin of Wikimedia Hackathons [7] ==
In order to both find out about the origin of Wikimedia programs, and
engage program leaders in conversation on the portal, we have posted a
question on the talk page of the Evaluation portal. If you have any
information on Wikimedia Hackathons, how they started and who was
coordinating the first one ever held, please comment on Meta [7] ! And
feel free to share any questions around planning and evaluation of programs
you may have.
As always, stay up-to-date by connecting on our portal [8].
On behalf of the Program Evaluation and Design team, thank you for your
time and attention.
*María Cruz * \\ Community Coordinator, PE&D Team \\ Wikimedia Foundation,
Inc.
mcruz(a)wikimedia.org | : @marianarra_ <https://twitter.com/marianarra_>
[1] Global Metrics page on Meta:
https://meta.wikimedia.org/wiki/Grants:Learning_%26_Evaluation/Global_metri…
[2] Learning Patterns on Globla Metrics:
https://meta.wikimedia.org/wiki/Category:Global_metrics_patterns
[3] Program Reports (beta):
https://meta.wikimedia.org/wiki/Grants:Evaluation/Evaluation_reports/2013
[4] Setting Goals and Targets virtual meet-up:
https://www.youtube.com/watch?v=ZL6md6Fljq8
[5] Choosing Goals and Measurable results:
https://meta.wikimedia.org/wiki/Grants:Evaluation/Program_Goals_and_Measura…
[6] Virtual event: Wikimetrics Overview:
https://plus.google.com/u/0/b/117126229120807344920/events/cs0r5b859n3hv0e3…
[7] Questions on the origin of Wikimedia Hackathon:
https://meta.wikimedia.org/wiki/Grants_talk:Evaluation#The_history_of_Wikim…
[8] Upcoming Events Section in PE&D portal:
https://meta.wikimedia.org/wiki/Grants:Evaluation/News#upcoming-events
