I did some checks on a few articles where very highly reputed authors doing checks on articles, and it seems like the system isn't able to detect very rare edits from such editors as it should. In fact it has marked the _correct_ versions as dubious while later versions with slight corrections from admins that are completely unfamiliar with the matter are marked as high quality.
Not much trustworty (oh shit, is that me??) http://wiki-trust.cse.ucsc.edu/index.php?title=Stave_church&oldid=255577... Lots of copyedits http://wiki-trust.cse.ucsc.edu/index.php?title=Stave_church&diff=3664979... A thrustworthy version (!) http://wiki-trust.cse.ucsc.edu/index.php/Stave_church
This is a very central problem to this kind of trust metrics, people are rated according to what they do at some point in time, without taking into account who they relates to and what is they previous history in other contexts. In the history of the Stave Church article, there is an archaeologist anyone able to locate the person? I think it should be possible to identify a person as an expert within a limited field of expertise, but it isn't easy to figure out how this should be done.
There is also the problem of the persons history. If someone edits and increases its own rating, how should that be handled? I think this should have implications on previous edits.
John E
Luca de Alfaro skrev:
Dear All,
we have a demo at http://wiki-trust.cse.ucsc.edu/ that features the whole English Wikipedia, as of its February 6, 2007 snapshot, colored according to text trust. This is the first time that even we can look at how the "trust coloring" looks on the whole of the Wikipedia! We would be very interested in feedback (the wikiquality-l@lists.wikimedia.org mailto:wikiquality-l@lists.wikimedia.org mailing list is the best place).
If you find bugs, you can email us at http://groups.google.com/group/wiki-trust http://groups.google.com/group/wiki-trust
Happy Holidays!
Luca
PS: yes, we know, some images look off. It is currently fairly difficult for a site outside of the Wikipedia to fetch Wikipedia images correctly.
PPS: there are going to be a few planned power outages on our campus in the next days, so if the demo is off, try again later.
Wikiquality-l mailing list Wikiquality-l@lists.wikimedia.org http://lists.wikimedia.org/mailman/listinfo/wikiquality-l