<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div>WSC, thanks for your note, which gives me the opportunity to clarify some gaps in the current RCom review procedure.<div><br></div><div>There are two separate considerations that apply to this project specifically:</div><div><br></div><div>1) the researcher asked us whether the integration of the questionnaire into features WMF is currently developing (such as MoodBar) was feasible from a technical standpoint. I consulted my colleagues in the product team as the question of available resources and technical feasibility needs to be settled on their side independently of the RCom's assessment of the proposal. I could have replied privately about this request but I thought it'd be useful to make my response public to allow other RCom members to review it.</div><div><br></div><div>2) the researcher shared with me a list of questions that he is planning to use for this study and specifically asked me not to circulate this document publicly. He's comfortable about sharing this document individually with RCom members as long as it's not posted on a publicly indexed mailing list.</div><div><br></div><div>This addresses two separate questions you're asking:</div><div><br></div><div>• is there some information that would be inappropriate to post on public fora as part of the review of a research proposal?</div><div>• are there any parts of a research proposal whose assessment is of exclusive WMF competence and not of the community or the Research Committee?</div><div><br></div><div>The answer to both questions is yes.</div><div><br></div><div>There are many cases I can think of in which a public forum is not appropriate for reviewing research proposals. On top of the Wiki Anxiety case (a research protocol that the researcher doesn't want to be publicly circulated until the research is actually run), there are other cases I've come across that fall under the same category. Authors of grant proposals who seek support from WMF in the form of, say, a non-committal letter of endorsement won't be able to publicly share the contents of the proposal while it's being evaluated as this would undermine the funder's decision. We might decide that RCom provides no support to projects that cannot be fully and transparently documented on Meta at the time of the review, but that would certainly leave us with a bunch of undergrad surveys as the only kind of collaboration requests we receive and I am not sure this is the direction we want to take. I think it's legitimate for a researcher to ask that under specific conditions a proposal (or parts thereof) should not be immediately disclosed until it's thoroughly reviewed AND funded. This probably means that we should use tools like OTRS to manage the parts of a request that cannot be discussed publicly for the above reasons. In the specific case of the Wiki Anxiety protocol, I am happy to share the annexes of the proposal with any of you, please let me know off-list if you wish to read it.</div><div><br></div><div>The second consideration is that there are multiple cases in which a proposal (or parts thereof) needs to be assessed by WMF independently and prior to RCom's own assessment. These include:</div><div>• projects that require the allocation of technical resources or engineer time from WMF;</div><div>• projects that require access to private data (in ways that are compliant with our privacy policy) and engineer supervision on this process;</div><div>• projects that require a review from our Legal team;</div><div>This doesn't mean bypassing RCom but ensuring that the project meets the minimum technical requirements to be implemented (without which it's pointless for the researcher to invest further effort).</div><div><br></div><div>I am sorry to hear you felt disconnected from the review process, I think your feedback on this and other projects is extremely helpful, but please let me know if the above distinction answers your concerns. </div><div>The question of reviewing some aspects of a project via private channels is definitely an issue that deserves further discussion and I'd like to hear how RCom members feel about it.</div><div><br></div><div>Dario</div></div><div><br></div><br><div><div>On Sep 8, 2011, at 1:24 PM, WereSpielChequers wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite">Hi Dario,<br><br>I asked if I could see the questionnaire. None of my talk threads have been responded to, but you've added a new thread that includes the sentence "I don't know whether you would be using only a subset of the questions
listed in the Wiki Anxiety/Usability Inventory (a document that was
shared privately with WMF), but the questionnaire in its current state
(46+22 questions)". So I now know how long it is, but it has been shared privately and so presumably I can't have it.<br><br>Which leaves me feeling somewhat disconnected from the process.<br><br>I don't know whether the researcher has been asked if the survey can be shared with WMF volunteers on RCOM, or why the secrecy.<br>
<br>Currently our emails are logged on the Internet for all to see, so I'm not sure how we handle the situation where someone is willing to engage with just the WMF. I suppose moving to OTRS resolves that, though it does leave me wondering how we maintain transparency to the community. I suppose they key thing will be to set some boundaries as to what we are and are not prepared to do in Private.<br>
<br><br>WSC<br><br><br><br><div class="gmail_quote">On 8 September 2011 20:21, Dario Taraborelli <span dir="ltr"><<a href="mailto:dtaraborelli@wikimedia.org">dtaraborelli@wikimedia.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<div style="word-wrap: break-word;">I don't understand, that was my feedback to the researcher based on discussions I had with other product people at WMF (regarding technical aspects of the proposed integration with MoodBar, which are of direct WMF competence)<div>
<br></div><div><font color="#888888">Dario</font><div><div></div><div class="h5"><div><br><div><div>On Sep 8, 2011, at 12:16 PM, WereSpielChequers wrote:</div><br><blockquote type="cite">Apparently he's answered my query, but only to the WMF <a href="http://meta.wikimedia.org/wiki/Research_talk:Investigating_editing_anxiety_in_new_users" target="_blank">http://meta.wikimedia.org/wiki/Research_talk:Investigating_editing_anxiety_in_new_users</a><br>
<br>That rather puts me in an uncomfortable position, is there any point in my getting involved in this?<br><br>WSC<br><br><div class="gmail_quote">On 7 September 2011 21:55, Dario Taraborelli <span dir="ltr"><<a href="mailto:dtaraborelli@wikimedia.org" target="_blank">dtaraborelli@wikimedia.org</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;"><div style="word-wrap: break-word;">I think he's aware of the talk page as he made the very first edit<div>
<br></div><div><a href="http://meta.wikimedia.org/w/index.php?title=Research_talk:Investigating_editing_anxiety_in_new_users&oldid=2866546" target="_blank">http://meta.wikimedia.org/w/index.php?title=Research_talk:Investigating_editing_anxiety_in_new_users&oldid=2866546</a></div>
<div><br></div><div>I'll ping him again if we don't hear from him in the coming days</div><div><br></div><div>Thanks</div><div>Dario</div><div><div></div><div><div><br><div><div>On Sep 7, 2011, at 1:02 PM, WereSpielChequers wrote:</div>
<br><blockquote type="cite">Hi Dario,<div><br></div><div>Do we need to tell him there is a talkpage?</div><div><br></div><div>WSC<br><br><div class="gmail_quote">On 7 September 2011 20:29, Dario Taraborelli <span dir="ltr"><<a href="mailto:dtaraborelli@wikimedia.org" target="_blank">dtaraborelli@wikimedia.org</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">FYI Ben has updated the project description with further information about the sample and methods.<br>
Thanks WSC for the initial feedback,<br>
<font color="#888888"><br>
Dario<br>
</font><div><div></div><div><br>
On Aug 30, 2011, at 11:47 AM, Dario Taraborelli wrote:<br>
<br>
> A new project has been added to the Research directory: <a href="http://meta.wikimedia.org/wiki/Research:Investigating_editing_anxiety_in_new_users" target="_blank">http://meta.wikimedia.org/wiki/Research:Investigating_editing_anxiety_in_new_users</a><br>
><br>
> The PI – Benjamin Cowan – is an HCI researcher based in Edinburgh and I had a few conversations with him on this project over the last weeks.<br>
> This research sounds very timely and relevant to WMF's work on new user engagement (I am cc'ing the Summer of Research list), but we need to figure out how to best handle the recruitment of participants.<br>
> One option we discussed would be to (temporarily) integrate a questionnaire into the new MoodBar feature [1], but I need to discuss this internally with the tech people.<br>
><br>
> In the meantime your feedback is very welcome. I told Ben we need more information, for example on the target sample size. He'll be adding more details in the coming days.<br>
><br>
> Dario<br>
><br>
> [1] <a href="http://www.mediawiki.org/wiki/MoodBar" target="_blank">http://www.mediawiki.org/wiki/MoodBar</a><br>
<br>
<br>
_______________________________________________<br>
RCom-l mailing list<br>
<a href="mailto:RCom-l@lists.wikimedia.org" target="_blank">RCom-l@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/rcom-l" target="_blank">https://lists.wikimedia.org/mailman/listinfo/rcom-l</a><br>
</div></div></blockquote></div><br></div>
_______________________________________________<br>RCom-l mailing list<br><a href="mailto:RCom-l@lists.wikimedia.org" target="_blank">RCom-l@lists.wikimedia.org</a><br><a href="https://lists.wikimedia.org/mailman/listinfo/rcom-l" target="_blank">https://lists.wikimedia.org/mailman/listinfo/rcom-l</a><br>
</blockquote></div><br></div></div></div></div><br>_______________________________________________<br>
RCom-l mailing list<br>
<a href="mailto:RCom-l@lists.wikimedia.org" target="_blank">RCom-l@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/rcom-l" target="_blank">https://lists.wikimedia.org/mailman/listinfo/rcom-l</a><br>
<br></blockquote></div><br>
_______________________________________________<br>RCom-l mailing list<br><a href="mailto:RCom-l@lists.wikimedia.org" target="_blank">RCom-l@lists.wikimedia.org</a><br><a href="https://lists.wikimedia.org/mailman/listinfo/rcom-l" target="_blank">https://lists.wikimedia.org/mailman/listinfo/rcom-l</a><br>
</blockquote></div><br></div></div></div></div></div><br>_______________________________________________<br>
RCom-l mailing list<br>
<a href="mailto:RCom-l@lists.wikimedia.org">RCom-l@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/rcom-l" target="_blank">https://lists.wikimedia.org/mailman/listinfo/rcom-l</a><br>
<br></blockquote></div><br>
_______________________________________________<br>RCom-l mailing list<br><a href="mailto:RCom-l@lists.wikimedia.org">RCom-l@lists.wikimedia.org</a><br><a href="https://lists.wikimedia.org/mailman/listinfo/rcom-l">https://lists.wikimedia.org/mailman/listinfo/rcom-l</a><br></blockquote></div><br></body></html>