[Wikimedia-l] [Wiki Loves Monuments] New Program Evaluation report: Wiki Loves Monuments

[Jaime Anstee]

Hello Nemo,

Sorry for the confusing in-line, I entered the conversation late, and
appreciate your patience. I do not think I am understanding what definition
information you are asking for.  The definition of  how we defined the
windows for 3 and 6 month follow-up is written on the overview page in
reference note number 1 and I have now added a second reference to the
mediawiki reference page I shared as that is what the 5+/month is
referenced from.

The way the quarters are defined is also referenced in the main text of the
report with some additional note references. As we are looking at retention
of "active"editors at different follow-up points defined at 3 and 6 months
(as indication of short and intermediate term outcomes) we have outlined
how this was done as a more-or-less quarterly follow-up following the end
of program events.  So yes, the first quarter post event is October through
December and the second January through March.
Assessments are from Wikimetrics and based on a start day and time and end
day and time, not on account creation as these other metrics do as we are
evaluating outreach programs that have event dates and variable account
creation dates. The goal of the metric that was was mainly to assess the
number of "active" contributors that are actually recruited, survival has
been included mostly for added understanding of the how this "active"
requirement compares to survival (any activity in the window of interest).

Still, I am not sure if this is answering you either. If you are simply
suggesting we not look at retention at 3 and 6 month intervals but rather
at 1 week, 2 months, and 6 months, as exampled on your page link, I must
say that this is the first time for that suggestion  and that would be
something to discuss on the report talk page (or overview talk page).

If you have additional questions or comments, please share them on the
report talk pages where we would like these conversations to take place and
be recorded.

Thank you,

Jaime


-- 

Jaime Anstee, Ph.D
Program Evaluation Specialist
Wikimedia Foundation
+1.415.839.6885 ext 6869
www.wikimediafoundation.org

Imagine a world in which every single human being can freely share in the
sum of all knowledge. Help us make it a reality!
*https://donate.wikimedia.org <https://donate.wikimedia.org/>*



On Sat, Jan 25, 2014 at 2:18 PM, Federico Leva (Nemo) <nemowiki at gmail.com>wrote:

> Hi Jaime.
> Your inline replying format highly confuses me, but I tried to reconstruct
> what you meant to say and I believe it's what below.
>
> Jaime Anstee, 25/01/2014 20:19:
>
>  On Sat, Jan 25, 2014 at 6:10 AM, Federico Leva (Nemo)
>>
> >
>
>> Is "active editor retention" a metric defined somewhere?
>>>
>>> It's not in <https://meta.wikimedia.org/wiki/Category:WMF_
>>> standardized_editor_classes>.  [...]
>>>
>>
>> Yes -
>> https://www.mediawiki.org/wiki/Analytics/Metric_definitions#Active_editor
>>
>> Thank you for asking, and mentioning that it is not linked in the
>> section.  I will reference that link there.
>>
>
> I know what an "active editor" is, you'll see in the history that I
> contributed to the section you linked. I asked about the "rate of active
> editor retention" as Asaf called it, or... "Six-month follow-up Active
> second quarter of retention follow-up" (??) as mentioned in the page.
> Apart from the confusing terminology, you'll note that it doesn't match
> with the (draft?) definition <https://meta.wikimedia.org/
> wiki/Research:Surviving_new_editor> even with non-standard n=1, m=15,
> t_2=90 days and t_1 < 0 unless you arbitrarily pose T = end of September.
> You may want to align definitions a bit.
>
>
>  I would like to point out that
>> the overview page to the set of reports does contain a lot of important
>> information about how things were defined and are reported in each
>> programs
>> evaluation report.
>>
>
> If you mean <https://meta.wikimedia.org/wiki/Programs:Evaluation_
> portal/Library/Overview#Recruitment_and_retention>, it doesn't contain
> any definition for the metric.
>
> Nemo
>
>
> _______________________________________________
> Wikimedia-l mailing list
> Wikimedia-l at lists.wikimedia.org
> Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l,
> <mailto:wikimedia-l-request at lists.wikimedia.org?subject=unsubscribe>
>