Hello Nemo,
Sorry for the confusing in-line, I entered the conversation late, and
appreciate your patience. I do not think I am understanding what definition
information you are asking for. The definition of how we defined the
windows for 3 and 6 month follow-up is written on the overview page in
reference note number 1 and I have now added a second reference to the
mediawiki reference page I shared as that is what the 5+/month is
referenced from.
The way the quarters are defined is also referenced in the main text of the
report with some additional note references. As we are looking at retention
of "active"editors at different follow-up points defined at 3 and 6 months
(as indication of short and intermediate term outcomes) we have outlined
how this was done as a more-or-less quarterly follow-up following the end
of program events. So yes, the first quarter post event is October through
December and the second January through March.
Assessments are from Wikimetrics and based on a start day and time and end
day and time, not on account creation as these other metrics do as we are
evaluating outreach programs that have event dates and variable account
creation dates. The goal of the metric that was was mainly to assess the
number of "active" contributors that are actually recruited, survival has
been included mostly for added understanding of the how this "active"
requirement compares to survival (any activity in the window of interest).
Still, I am not sure if this is answering you either. If you are simply
suggesting we not look at retention at 3 and 6 month intervals but rather
at 1 week, 2 months, and 6 months, as exampled on your page link, I must
say that this is the first time for that suggestion and that would be
something to discuss on the report talk page (or overview talk page).
If you have additional questions or comments, please share them on the
report talk pages where we would like these conversations to take place and
be recorded.
Thank you,
Jaime
--
Jaime Anstee, Ph.D
Program Evaluation Specialist
Wikimedia Foundation
+1.415.839.6885 ext 6869
www.wikimediafoundation.org
Imagine a world in which every single human being can freely share in the
sum of all knowledge. Help us make it a reality!
*https://donate.wikimedia.org <https://donate.wikimedia.org/>*
On Sat, Jan 25, 2014 at 2:18 PM, Federico Leva (Nemo) <nemowiki(a)gmail.com>wrote;wrote:
Hi Jaime.
Your inline replying format highly confuses me, but I tried to reconstruct
what you meant to say and I believe it's what below.
Jaime Anstee, 25/01/2014 20:19:
On Sat, Jan 25, 2014 at 6:10 AM, Federico Leva (Nemo)
Is "active editor retention" a metric
defined somewhere?
It's not in <https://meta.wikimedia.org/wiki/Category:WMF_
standardized_editor_classes>. [...]
Yes -
https://www.mediawiki.org/wiki/Analytics/Metric_definitions#Active_editor
Thank you for asking, and mentioning that it is not linked in the
section. I will reference that link there.
I know what an "active editor" is, you'll see in the history that I
contributed to the section you linked. I asked about the "rate of active
editor retention" as Asaf called it, or... "Six-month follow-up Active
second quarter of retention follow-up" (??) as mentioned in the page.
Apart from the confusing terminology, you'll note that it doesn't match
with the (draft?) definition <https://meta.wikimedia.org/
wiki/Research:Surviving_new_editor> even with non-standard n=1, m=15,
t_2=90 days and t_1 < 0 unless you arbitrarily pose T = end of September.
You may want to align definitions a bit.
I would like to point out that
the overview page to the set of reports does
contain a lot of important
information about how things were defined and are reported in each
programs
evaluation report.
If you mean <https://meta.wikimedia.org/wiki/Programs:Evaluation_
portal/Library/Overview#Recruitment_and_retention>, it doesn't contain
any definition for the metric.
Nemo
_______________________________________________
Wikimedia-l mailing list
Wikimedia-l(a)lists.wikimedia.org
Unsubscribe:
https://lists.wikimedia.org/mailman/listinfo/wikimedia-l,
<mailto:wikimedia-l-request@lists.wikimedia.org?subject=unsubscribe>