Given the slowing of discussion of this project on the talk page, the unanimous opinion of those involved in discussion and the lack of objection at the village pump, I&#39;d like to give these guys our support at this time.  Are there any objections?<div>

<br></div><div>They are hoping to go to their IRB tomorrow with confidence that they&#39;ve discussed the project with us first.</div><div><br></div><div>--Aaron</div><div><br></div><div><br><div class="gmail_quote">On Sun, Jul 31, 2011 at 11:19 AM, Aaron Halfaker <span dir="ltr">&lt;<a href="mailto:aaron.halfaker@gmail.com">aaron.halfaker@gmail.com</a>&gt;</span> wrote:<br>

<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">Hey guys!<div><br></div><div>There is another project looking to perform subject recruitment that needs our assistance. </div>

<div><br></div><div>It looks like the researchers are looking to contact new article creators with different message styles to detect a causal relationship in changes to editor behavior.  </div>
<div><br></div><div><a href="http://meta.wikimedia.org/wiki/Research:Effects_of_Feedback_on_Participation_in_Wikipedia#Benefits_for_the_Wikimedia_Community" target="_blank">http://meta.wikimedia.org/wiki/Research:Effects_of_Feedback_on_Participation_in_</a><a href="http://meta.wikimedia.org/wiki/Research:Effects_of_Feedback_on_Participation_in_Wikipedia#Benefits_for_the_Wikimedia_Community" target="_blank">Wikipedia</a></div>


<div><br></div><div>I&#39;ll be moving my comments and questions to the project talk page, so please continue any discussion there.</div><div><br></div><div>-Aaron<br><br><div class="gmail_quote">---------- Forwarded message ----------<br>


From: <b class="gmail_sendername">Haiyi Zhu</b> <span dir="ltr">&lt;<a href="mailto:haiyiz@cs.cmu.edu" target="_blank">haiyiz@cs.cmu.edu</a>&gt;</span><br>Date: Fri, Jul 29, 2011 at 4:47 PM<br>Subject: Re: Conducting Experiments on Effects of Messages in Wikipedia<br>


To: Aaron Halfaker &lt;<a href="mailto:aaron.halfaker@gmail.com" target="_blank">aaron.halfaker@gmail.com</a>&gt;<br>Cc: Robert Kraut &lt;<a href="mailto:robert.kraut@cmu.edu" target="_blank">robert.kraut@cmu.edu</a>&gt;, nkittur &lt;<a href="mailto:nkittur@cs.cmu.edu" target="_blank">nkittur@cs.cmu.edu</a>&gt;, Amy X Zhang &lt;<a href="mailto:amyz@andrew.cmu.edu" target="_blank">amyz@andrew.cmu.edu</a>&gt;, Jenny He &lt;<a href="mailto:jipingh@andrew.cmu.edu" target="_blank">jipingh@andrew.cmu.edu</a>&gt;<br>


<br><br>Hi Aaron<div><br></div><div>We have created a project page for the experiment we would like to do. <a href="http://meta.wikimedia.org/wiki/Research:Effects_of_Feedback_on_Participation_in_Wikipedia#Benefits_for_the_Wikimedia_Community" target="_blank">http://meta.wikimedia.org/wiki/Research:Effects_of_Feedback_on_Participation_in_Wikipedia#Benefits_for_the_Wikimedia_Community</a></div>



<div>We are ready for review. Would you please help us get the ball rolling?</div><div><br></div><div>Thanks a lot!!</div><div>Haiyi</div><div><div></div><div><div><br><br><div class="gmail_quote">On Wed, Jul 6, 2011 at 8:23 AM, Aaron Halfaker <span dir="ltr">&lt;<a href="mailto:aaron.halfaker@gmail.com" target="_blank">aaron.halfaker@gmail.com</a>&gt;</span> wrote:<br>



<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Haiyi,<div><br></div><div>This study sounds like it would be relevant if submitted to the Wikimedia Research Committee(<a href="http://meta.wikimedia.org/wiki/Research:Committee" target="_blank">http://meta.wikimedia.org/wiki/Research:Committee</a>) for review as a Subject Recruitment request(<a href="http://meta.wikimedia.org/wiki/Research:Subject_recruitment" target="_blank">http://meta.wikimedia.org/wiki/Research:Subject_recruitment</a>).  I think this should be an excellent venue for feedback, and if things go well, a go-ahead/endorsement from the committee.  You&#39;ll have to create a project page (see the form on <a href="http://meta.wikimedia.org/wiki/Research:Subject_recruitment" target="_blank">http://meta.wikimedia.org/wiki/Research:Subject_recruitment</a>) and then let me know when you are ready for review and I can get the ball rolling.<span style="font-family:sans-serif;font-size:12px;line-height:17px"></span></div>





<div><br></div><div>The review is relatively unstructured and consists primarily of questions and requests raised on the talk page.</div><div><br></div><div>Let me know if you have questions.</div><div><br></div><font color="#888888"><div>



-Aaron</div></font><div><div></div><div>

<div><br><div class="gmail_quote">On Wed, Jul 6, 2011 at 12:13 AM, Haiyi Zhu <span dir="ltr">&lt;<a href="mailto:haiyiz@cs.cmu.edu" target="_blank">haiyiz@cs.cmu.edu</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">





<div>Hi Aaron,</div><div><br></div><div>This is Haiyi Zhu from Carnegie Mellon University. I am working with Bob Kraut and Niki Kittur. I read your work about the effects of revert in Wikipedia. That is very interesting. Also congratulations on getting the summer intern job in Wikipedia.</div>






<div><br></div><div>We have been planning on conducting an experiment to investigate the effects of messages on participation in Wikipedia. We are wondering if there is any appropriate place in Wikipedia website for us to post our plan of experiments and get feedback from Wikipedia foundations and experienced Wikipedians. It would be really helpful if you could point us to the right place. </div>






<div><br></div><div>I also attach the details of our experiments.</div><div><br></div><div><div>Thanks for your help!</div><div>Haiyi</div></div><div><br></div><div> </div><div>1. Purpose of the study</div><div><br></div>






<div>Wikipedia is one of the most successful examples of social production online, and the key components to its continued success is maintaining a large number of contributions made by a large and diverse community of editors. The quality of Wikipedia articles is also maintained by its community of editors through shared leadership behaviors, which are leadership behaviors that come from all members at all levels (e.g. all Wikipedia users), not only members in a defined leadership position (e.g. Wikipedia administrators). Shared leadership behaviors in Wikipedia include, but are not limited to, giving positive comments to a contributor for creating a well-written new article (positive task-based message), criticisms or reprimands to a contributor for not complying to Wikipedia guidelines (negative task-based message), giving directions to correct an error (directive task-based message). All of these aforementioned messages could be written in a manner that is sociable and person-focused--friendly, supportive and caring, and seeks to retain relationships with others, or not sociable.  Past research has shown that person-focused leadership was effective in motivating users to contribute more, while negative messages lead to decrease in motivation (Effectiveness of Shared Leadership, CSCW, 2012, under review, <a href="http://www.cs.cmu.edu/~haiyiz/ttt/SharedLeadership_fifthpdf.pdf" target="_blank">http://www.cs.cmu.edu/~haiyiz/ttt/SharedLeadership_fifthpdf.pdf</a>). Therefore, we are interested in learning how task-based messages (positive, negative, directive) with a sociable(person-focused) component would effect Wikipedia users&#39; contributions. </div>






<div><br></div><div>We will test how receiving the different types of messages (positive task-based, negative task-based, or directive message) with and without a sociable component, as well as the recipient&#39;s level of experience will influence a recipient&#39;s future contributions to Wikipedia. We will do so by having researchers post messages on the recipients&#39; Wikipedia User Talk page, and then we will track the recipients&#39; level of contribution over time.</div>






<div><br></div><div>2. Research procedures:</div><div><br></div><div>The research procedure will not require any extra effort and activity by the participants, other than their usual participation on Wikipedia. The time period of this experiment will take place from July 1st to August. The location will take place online on the Wikipedia website.</div>






<div><br></div><div> We will be posting experimentally altered messages to the participants&#39; Wikipedia User Talk page, which is public and can be seen by anyone. The experiment researchers will identify a list of newly created articles that are two to ten days old. We will only post a response to a newly-created article that is at least two days old, in accordance to Wikipedia&#39;s policy of &quot;don&#39;t bite the newcomers&quot; (<a href="http://en.wikipedia.org/wiki/Wikipedia:BITE" target="_blank">http://en.wikipedia.org/wiki/Wikipedia:BITE</a>). </div>






<div><br></div><div>We will then categorize the new articles as containing errors or not containing errors according to a set of criteria determined by Wikipedia guidelines. The creator of the new article containing errors would randomly be assigned to receive a positive task-based message, negative task-based message, directive message, or non task-based message, and each type of message would also be randomly assigned to be sociable or not sociable. The same assignment procedure will be given to the creator of an article without errors, with the exclusion of negative task-based feedback. </div>






<div><br></div><div>Also, all messages sent by the experimenter will be prepared beforehand in templates (see the section 4) , which are designed to mimic messages sent by other Wikipedia users, and therefore the risk associated with these messages are no greater than the risks experienced by a Wikipedia user during everyday interactions on Wikipedia. We will then extract the users&#39; activity data after one to two weeks in order to examine the users level of contribution; we will also extract some user info, such as date of first edit,  in order to assess the recipients&#39; level of experience. However, no personal information that could be used to identify the identity of the recipient will be extracted, used, or recorded in this experiment.  </div>






<div><br></div><div>3. We need your help!</div><div>If you are interested in our research project and would like to participate in our experiment and send out messages, please sign here. </div><div><br></div><div>4. Appendix: example messages</div>






<div><br></div><div>4.1 Each message has some base, non-task focused/non-social content.</div><div>I see you created the new article [[“{{{{contrib}}}}]].  New articles are typically reviewed by users on the [[Wikipedia:New_pages_patrol|‘New Article Patrol’]].  If your article has not been reviewed, it should happen soon.  Thank you, ~~~~</div>






<div>I see that you recently created the new article [[“{{{{contrib}}}}]]. As you know, Wikipedia is always a [work in progress].  So thank you, ~~~~</div><div>I see that you recently created the new article [[contrib]].  It would probably fit into project [[Project]].  (although a good suggestion, this message is not yet compatible with the various categories,</div>






<div><br></div><div>4.2. The social messages have social content in the salutation before the base message and in the closing after the base message:</div><div><br></div><div>Salutations: </div><div><br></div><div>Happy Monday, {{SUBST:BASEPAGENAME}}! </div>






<div>Greetings {{SUBST:BASEPAGENAME}}!</div><div>Hi {{SUBST:BASEPAGENAME}}!</div><div>Welcome {{SUBST:BASEPAGENAME}}!  (new users only)</div><div><br></div><div><br></div><div>Closing: </div><div><br></div><div>Happy editing! Hope your day is going well and you are having fun.  ~~~</div>






<div>It’s nice to see you editing! Hope you’ll stick around! ~~~~</div><div>Have a fun and productive day! Cheers, ~~~~</div><div>Let me know if there is any way I can help.  Hope you sill stick around.  Thanks, Amy ~~~~</div>






<div>Let me know if I can be of any help and I’ll do my best! ~~~~</div><div><br></div><div><br></div><div><br></div><div>4.3. The positive feedback message includes some general positive comment and an article specific comment</div>






<div><br></div><div>General: This article looks very well put together. [ Point to a specific praiseworthy element , based on article content.]</div><div><br></div><div>Specific:</div><div><br></div><div>The image greatly improves the article.</div>






<div><br></div><div>The citations and references seem to abide to Wikipedia’s referencing guidelines.</div><div><br></div><div>There is a good number of citations and references. </div><div>The content seems pretty substantial for a new article.</div>






<div>The content seems well-organized. </div><div>The information is presented clearly and is easy to understand.</div><div>The layout of the article makes it very clear.</div><div>The headings and sections seem appropriate. </div>






<div><br></div><div>4.4. The negative feedback message includes some general negative comment and an article specific comment</div><div><br></div><div>General: However, I noticed the article contains errors.  [Point to a specific error, based on article content.]</div>






<div><br></div><div>Specific:</div><div><br></div><div>The article contains spelling/grammatical error’s (specifics)</div><div>The article currently does not contain any [[WP:REF|references]].</div><div>The article’s image currently does not contain any captions. </div>






<div>The references in the article do not follow Wikipedia guidelines. There is a tutorial on formatting citations at [[Wikipedia:Referencing]]</div><div>The article does not contain any [[Help:Link|Wikilinks]], and so doesn’t follow [[Wikipedia:Manual of Style (linking)|Wikipedia style guidelines]]. </div>






<div>The article does not contain in-line citations, and so doesn’t follow [[WP:REF|Wikipedia style guidelines]]. </div><div>The article is confusing.  I do not understand what you are trying to say. </div><div>The article’s footer sections are not in the [[WP:FOOTER|standard order]].</div>






<div><br></div><div><br></div><div>4.5. The directive  message asks the editor to do a specific comment on an article related to the one they created.</div><div><br></div><div>Other sample tasks:</div><div><br></div><div>






It would be great if you could also improve the related article __.</div><div>It would be great if you could also [[Help:Files|upload a picture]] for the related article__. </div><div>It would be great if you could also [[WP:REF|add references]] to the related article __.</div>






<div>It would be great if you could also create new articles for [the red links that do not lead to another article yet].</div><div>It would be great if you could also [[Talk:__|give feedback]] for the related article __.</div>






<div>It would be great if you could also clean-up the related article __.</div><div>It would be great if you could also [[WP:MOS|Wikify]] the related article __.</div><div>It would be great if you could also help merge the related article __.</div>






<div>It would be great if you could also participate in the [discussion] about deleting __.  </div><div><br></div><div><br></div><div><br></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></div></div><br></div>
</blockquote></div><br></div>