[Wikimedia-l] 2012 Editor survey launched

[Tilman Bayer]

Hi John,

On Fri, Nov 2, 2012 at 6:05 PM, John Vandenberg <jayvdb at gmail.com> wrote:
> Hi Tilman,
>
> Could you explain the logic behind the survey link not being static until
> the user completes the survey or dismisses the notice?
I guess you are referring to the fact that the survey invitation
banner is designed to be shown only once to each user? This is
explained in the Q&A for the survey:
https://meta.wikimedia.org/wiki/Research:Wikipedia_Editor_Survey_2012#Why_will_a_user_see_the_link_to_the_survey_only_once.3F_How.3F
In short, it's intended to reduce bias towards more frequent editors.
There are reasons for and against this setup, but it's one of the many
things that we want to keep consistent with the last survey so as to
be able to do longitudinal analysis, i.e. identify trends.

(In case this is not what you meant, feel free to rephrase the
question and I will try to reply again.)

>
> I appreciate that you're offering, via email, to give people the survey
> link if they missed it, but that will influence who ends up your survey
> population. Not everyone on your target population is subscribed to a list
> whetr this offer has been made.
I understand this concern from a theoretical standpoint, but
considering the fact that only four people have requested such a link
so far, the bias that this introduces is likely to be negligible. - If
one goes down that road, one would need to worry much more about the
effect of announcements and discussions about the survey on mailing
lists and on Meta before it has completed, but this is a price we are
happy to pay to involve the community and achieve transparence.

>
> John Vandenberg.
> sent from Galaxy Note
> On Oct 31, 2012 7:26 AM, "Tilman Bayer" <tbayer at wikimedia.org> wrote:
>
>> Hi all,
>>
>> we have just launched the Foundation's 2012 editor survey; with
>> invitations to participate being shown to logged-in users on Wikipedia
>> and Commons.
>>
>> A few quick facts about the survey (for more refer to
>> https://meta.wikimedia.org/wiki/Research:Wikipedia_Editor_Survey_2012
>> ):
>>
>> * This is the third survey of editors as envisaged in the Foundation's
>> 2010-15 strategic plan "in order to take the pulse of the community
>> and identify pressing issues or concerns", after the April 2011 and
>> December 2011 surveys.
>>
>> * The first main purpose of this survey is to continue the work of the
>> 2011 studies (conducted by Mani Pande and Ayush Khanna), with a focus
>> on tracking changes since last year and identifying trends.
>> Which is why many questions are being repeated from last time.
>>
>> * The second emphasis in this instance of the survey is to measure the
>> satisfaction of the editing community with the work of the Wikimedia
>> Foundation.
>>
>> * This is the first editor survey that includes a non-Wikipedia
>> project (Commons, for the questions that are non Wikipedia-specific).
>>
>> * Thanks to everyone who commented on the draft questionnaire after we
>> solicited feedback on this list and in and IRC office hour, as well as
>> to those who commented about the last survey. We made several changes
>> based on the feedback, and tried to reply to all concerns.
>>
>> * Also many thanks to all volunteer translators who reviewed or
>> contributed translations; the questionnaire is available in 14
>> languages (Italian, Polish and Portuguese will launch a bit later).
>>
>> * As with the previous two surveys, the results will be published in
>> the following forms: A "topline" report detailing the percentage of
>> responses for each question, a series of posts on
>> https://blog.wikimedia.org analyzing the results, and a data set
>> consisting of anonymized responses which others can use to do their
>> own analyses. This time we will also aim to produce language-specific
>> topline reports (an approach we already tested for Chinese with the
>> data from the December 2011 survey).
>>
>> --
>> Tilman Bayer
>> Senior Operations Analyst (Movement Communications)
>> Wikimedia Foundation
>> IRC (Freenode): HaeB
>>
>> _______________________________________________
>> Wikimedia-l mailing list
>> Wikimedia-l at lists.wikimedia.org
>> Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l
>>
> _______________________________________________
> Wikimedia-l mailing list
> Wikimedia-l at lists.wikimedia.org
> Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l



-- 
Tilman Bayer
Senior Operations Analyst (Movement Communications)
Wikimedia Foundation
IRC (Freenode): HaeB