Subject:  Wiki-research-l Digest, Vol 120, Issue 16 

Can someone who has access to that paper please share the method and results as fair use?

Here are a few key paragraphs from the methods and results section. 


Method

"We test two “social conditions” Anonymous  vs. Identity  disclosure ( anonymous : participants do not know each other; identity : participants were first asked to introduce themselves before experiments and, during the experiments, participants were shown name of their reviewer on the computer screen and vice versa) . In addition to social condition, we introduce “repeated matching” ( 1 round : matching of counterpart and reviewer changes every round; 3 round : each participant will be matched with the same counterpart and the same reviewer for three consecutive rounds) as another dimension to compare the effect of short-term and long-term social pressure. Employing 2 × 2 design, our experiments consist of four treatments, varying in two dimensions. 

Parameters used are P =120, k =0.15. NE prediction is e* =10 under correct-reporting (Proposition 1) and e* =1  under  over-reporting  (Proposition  2).  Expected  p rofit  is π *=45  and π *=59.85,  respectively. Experiments were implemented using z-Tree software (Fischbacher 2007). Participants of experiments consist  of  108  undergraduate  students  at  a  large  pu blic  research  university  in  the  United  States.  For Anonymous  1 round   treatment,  we  conducted  three  experimental  sessions.  Each  of  the  rest  three treatments consisted of two sessions. Each session had 12 participants with 15 decision rounds. Subjects received a course credit and cash payment based on their results of the game."

Findings

"In Anonymous , correct-reporting is most frequently observed at 42% (1-round) and 59% (3-round). In Identity ,  over-reporting  accounts  for  more  than  64%  and  72% ,  respectively.  The  findings  in  reporting behaviors are in line with our expectation as shown  on Propositions 1 and 2. That is, when identity is revealed,  reviewers  feel  social  pressure  to  be  nice   toward  players.  Therefore,  evaluation  systems  are considered less reliable because it fails to reflect the true efforts. 

Another finding is that reporting behavior seems st rengthened for a longer period of matching. Repeate d matching seems to make reviewers form a stronger so cial pressure. For example, higher proportion of over-reporting in Identity 3 round  suggests an increased social pressure due to expec tation of a long-term relationship between reviewers and players. “

"Median efforts from four treatments are all lower than that of standard economics prediction (assuming objective-r eporting, e* =10). This suggests that players suspect reliability  of  evaluation  systems.  For Anonymous 1 round   and 3 round   where  correct-reporting  is observed at a high rate, the median efforts are  both  8.  This high median  efforts imply that players in anonymous  settings  generally  hold  a  stronger  belief   that  evaluation  systems  are  still  reliable  at  some extent. 

Surprisingly,  for Identity  1 round   where  scores  are  mostly  inflated,  the  median  effort  is  still  8.  The average effort is at 8.2, even higher than both Anonymous  treatments (7.3 and 7.6). This finding suggests a  gap  between  players’  belief  and  reviewers’  behavior.  While  reviewers  feel  strong  social  pressure  by revealing identity, players doubt that social pressure of reviewers will be enough to be nice. However , such doubt disappears when players recognize a long-term  relationship. For Identity 3 round , the median and average efforts decrease into 5 and 5.6, respectively, the lowest level among all treatments."




Kevin Crowston  | Distinguished Professor of Information Science |  School of Information Studies

Syracuse University
348 Hinds Hall
Syracuse, New York 13244
 (315) 443.1676    315.443.5806   e  mailto:crowston@syr.edu 
 
crowston.syr.edu