Yes, working with large data sets is fun. There are always surprises. For example top of the &#39;words, most reverted by trusted users&#39; are not the expected infantile type of things either. I haven&#39;t done the analysis on the full dump yet, but on the subset from the full histories of articles from the PAN 10 LAB test set following words came up top (sorted by chi-square, note that this is very preliminary and tokenization/regularization might have been wrong):<br>

<br>token, chi-sq, regular-diff-tok-cnt, revert-diff-tok-cnt<br>Image:Example.jpg|Ca 87959701.9043 113 7568<br>[[Media:Example.ogg] 5549492.56549 62 2196<br>title]][<a href="http://www.e">http://www.e</a> 606182.771025 0 363<br>

aaaaaaaaaaaaaaaaaaaa 305908.640902 0 365<br>[<a href="http://youtube.com/">http://youtube.com/</a> 253267.5237 189 407<br>pooooooooooooooooooo 214921.014803 0 375<br>you 154597.596739 18655 102007<br>ffffffffffffffffffff 129822.419517 1 238<br>

value=&quot;transparent&quot;&gt; 129575.702482 1 168<br>____________________ 126503.143626 23 166<br>language|Macedonian] 123467.452157 121 164<br>hhhhhhhhhhhhhhhhhhhh 119613.359035 0 280<br>!!!!!!!!!!!!!!!!!!!! 118479.373501 5 686<br>

AAAAAAAAAAAAAAAAAAAA 114581.582068 2 158<br>oooooooooooooooooooo 110263.074451 0 155<br>i 109590.406785 2620 55971<br><br>-- Cheers, Dmitry<br><br><br><br><br><div class="gmail_quote">On Fri, Aug 13, 2010 at 4:06 PM, Luca de Alfaro <span dir="ltr">&lt;<a href="mailto:luca@dealfaro.org">luca@dealfaro.org</a>&gt;</span> wrote:<br>

<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">Thanks, this is great fun!  As an Italian, let me quote: <div><br></div><div>(0.42477231329690346, (2745, 1166, 28, 110, 46, 1054, 341), &#39;Gun&#39;)<div>

(0.42474916387959866, (2990, 1270, 37, 149, 23, 1190, 321), &#39;Monkey&#39;)</div>
<div>(0.42443438914027148, (1105, 469, 20, 21, 2, 427, 166), &#39;Incas&#39;)</div><div>(0.42433090024330899, (2055, 872, 39, 45, 15, 825, 259), &#39;Italian Renaissance&#39;)</div><div>(0.42375950742484608, (2761, 1170, 34, 94, 24, 978, 461), &#39;Watermelon&#39;)</div>


<div>(0.42362613587191694, (2311, 979, 22, 121, 19, 937, 233), &#39;Puppy&#39;)</div><div>(0.4235686492495831, (1799, 762, 20, 83, 34, 669, 231), &#39;Crap&#39;)</div><div><br></div><div>It is absolutely great to see that Italian Renaissance (with Incas) is one of the few cultural topics that makes it as high in the list as the usual excrement-sex-infantile type of things!!</div>


<div><br></div><div>Luca</div><br><div class="gmail_quote"><div><div></div><div class="h5">On Fri, Aug 13, 2010 at 1:12 PM, Dmitry Chichkov <span dir="ltr">&lt;<a href="mailto:dchichkov@gmail.com" target="_blank">dchichkov@gmail.com</a>&gt;</span> wrote:<br>

</div></div><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;"><div><div></div><div class="h5">
If anybody is interested, I&#39;ve made a list of &#39;most reverted pages&#39; in the english wikipedia based on the analysis of the enwiki-20100130 dump. Here is the list:<br><a href="http://wpcvn.com/enwiki-20100130.most.reverted.tar.bz" rel="nofollow" target="_blank">http://wpcvn.com/enwiki-20100130.most.reverted.tar.bz</a><br>




<a href="http://wpcvn.com/enwiki-20100130.most.reverted.txt" rel="nofollow" target="_blank">http://wpcvn.com/enwiki-20100130.most.reverted.txt</a><br><br>This list was calculated using the following sampling criteria:<br>




* All pages from the enwiki-20100130 dump;<br>** Filtered pages with more than 1000 revisions;<br>** Filtered pages with revert ratios &gt; 0.3;<br>* Sorted in descending revert ratios.<br><br>Page revision is considered to be a revert if there is a previous revision with a matching MD5 checksum; <br>




BTW, if anybody needs it, the python code that identifies reverts, revert wars, self-reverts, etc is available (LGPL).<br><br>-- Regards, Dmitry<br>
<br></div></div>_______________________________________________<br>
Wiki-research-l mailing list<br>
<a href="mailto:Wiki-research-l@lists.wikimedia.org" target="_blank">Wiki-research-l@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/wiki-research-l" target="_blank">https://lists.wikimedia.org/mailman/listinfo/wiki-research-l</a><br>
<br></blockquote></div><br></div>
<br>_______________________________________________<br>
Wiki-research-l mailing list<br>
<a href="mailto:Wiki-research-l@lists.wikimedia.org">Wiki-research-l@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/wiki-research-l" target="_blank">https://lists.wikimedia.org/mailman/listinfo/wiki-research-l</a><br>
<br></blockquote></div><br>