On Thu, Jul 14, 2011 at 2:31 PM, David Gerard dgerard@gmail.com wrote:
Making all the rating data publicly available for analysis (with no usernames or IPs attached, of course) is a first step. Before proposing solutions to problems in the data, look at the data ;-)
A sound recommendation from the psychology literature on problem solving. To quote Eliezer Yudkowsky ( http://lesswrong.com/lw/ka/hold_off_on_proposing_solutions/ ) quoting Robyn Dawes (_Rational Choice in an Uncertain World_) expanding Norman R. F. Maier:
"...when a group faces a problem, the natural tendency of its members is to propose possible solutions as they begin to discuss the problem. Consequently, the group interaction focuses on the merits and problems of the proposed solutions, people become emotionally attached to the ones they have suggested, and superior solutions are not suggested. Maier enacted an edict to enhance group problem solving: "Do not propose solutions until the problem has been discussed as thoroughly as possible without suggesting any." It is easy to show that this edict works in contexts where there are objectively defined good solutions to problems."