Thanks Tilman. Good to see the offer is in the public FAQ.
I was on my phone at the time I saw it, and having some time on my hands I tried to fill it in. I managed to screw up the survey software on the languages selection by trying to select more than one, and then it wouldnt let me pick any. I quit thinking I would get another chance...on my desktop.
I dont remember if the survey told me that I would only have one chance...
Do you know how many people have seen the banner vs how many have completed it?
Is there a page which lists pros and cons of this approach?
I think the WMF should collect all the survey data they can. Maximum ROI and all that. You can use models to select a subset of the 2012 data that would be comparable to the 2011 data.
John Vandenberg. sent from Galaxy Note On Nov 3, 2012 10:58 AM, "Tilman Bayer" tbayer@wikimedia.org wrote:
Hi John,
On Fri, Nov 2, 2012 at 6:05 PM, John Vandenberg jayvdb@gmail.com wrote:
Hi Tilman,
Could you explain the logic behind the survey link not being static until the user completes the survey or dismisses the notice?
I guess you are referring to the fact that the survey invitation banner is designed to be shown only once to each user? This is explained in the Q&A for the survey:
https://meta.wikimedia.org/wiki/Research:Wikipedia_Editor_Survey_2012#Why_wi... In short, it's intended to reduce bias towards more frequent editors. There are reasons for and against this setup, but it's one of the many things that we want to keep consistent with the last survey so as to be able to do longitudinal analysis, i.e. identify trends.
(In case this is not what you meant, feel free to rephrase the question and I will try to reply again.)
I appreciate that you're offering, via email, to give people the survey link if they missed it, but that will influence who ends up your survey population. Not everyone on your target population is subscribed to a
list
whetr this offer has been made.
I understand this concern from a theoretical standpoint, but considering the fact that only four people have requested such a link so far, the bias that this introduces is likely to be negligible. - If one goes down that road, one would need to worry much more about the effect of announcements and discussions about the survey on mailing lists and on Meta before it has completed, but this is a price we are happy to pay to involve the community and achieve transparence.
John Vandenberg. sent from Galaxy Note On Oct 31, 2012 7:26 AM, "Tilman Bayer" tbayer@wikimedia.org wrote:
Hi all,
we have just launched the Foundation's 2012 editor survey; with invitations to participate being shown to logged-in users on Wikipedia and Commons.
A few quick facts about the survey (for more refer to https://meta.wikimedia.org/wiki/Research:Wikipedia_Editor_Survey_2012 ):
- This is the third survey of editors as envisaged in the Foundation's
2010-15 strategic plan "in order to take the pulse of the community and identify pressing issues or concerns", after the April 2011 and December 2011 surveys.
- The first main purpose of this survey is to continue the work of the
2011 studies (conducted by Mani Pande and Ayush Khanna), with a focus on tracking changes since last year and identifying trends. Which is why many questions are being repeated from last time.
- The second emphasis in this instance of the survey is to measure the
satisfaction of the editing community with the work of the Wikimedia Foundation.
- This is the first editor survey that includes a non-Wikipedia
project (Commons, for the questions that are non Wikipedia-specific).
- Thanks to everyone who commented on the draft questionnaire after we
solicited feedback on this list and in and IRC office hour, as well as to those who commented about the last survey. We made several changes based on the feedback, and tried to reply to all concerns.
- Also many thanks to all volunteer translators who reviewed or
contributed translations; the questionnaire is available in 14 languages (Italian, Polish and Portuguese will launch a bit later).
- As with the previous two surveys, the results will be published in
the following forms: A "topline" report detailing the percentage of responses for each question, a series of posts on https://blog.wikimedia.org analyzing the results, and a data set consisting of anonymized responses which others can use to do their own analyses. This time we will also aim to produce language-specific topline reports (an approach we already tested for Chinese with the data from the December 2011 survey).
-- Tilman Bayer Senior Operations Analyst (Movement Communications) Wikimedia Foundation IRC (Freenode): HaeB
Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l
Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l
-- Tilman Bayer Senior Operations Analyst (Movement Communications) Wikimedia Foundation IRC (Freenode): HaeB
Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l