<div dir="ltr"><div id="gmail-magicdomid903" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-size:12px;font-family:"helvetica neue",arial,sans-serif"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">Hey,</span></div><div id="gmail-magicdomid905" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-size:12px;font-family:"helvetica neue",arial,sans-serif"><br style="margin:0px;padding:0px"></div><div id="gmail-magicdomid3054" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">This is the 30th and 31st weekly update from the revision scoring team that we have sent to this mailing list.  We accidentally skipped a week again.</span></div><div id="gmail-magicdomid1095" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><br style="margin:0px;padding:0px"></div><div id="gmail-magicdomid3065" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z gmail-b" style="margin:0px;padding:1px 0px"><b style="margin:0px;padding:0px">New development:</b></span></div><div id="gmail-magicdomid3056" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><ul class="gmail-list-bullet1" style="margin:0px 0px 0px 1.5em;padding:0px"><li style="margin:0px;padding:0px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">We added a new "lowest" sensitivity level to ORES review tool.  This new sensistivity level will only flag edits that ORES is very confident are actually damaging[1]. </span></li></ul></div><div id="gmail-magicdomid3057" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><ul class="gmail-list-bullet1" style="margin:0px 0px 0px 1.5em;padding:0px"><li style="margin:0px;padding:0px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">We applied the MediaWiki standard color palette to Wikilabels[2]</span></li></ul></div><div id="gmail-magicdomid3058" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><ul class="gmail-list-bullet1" style="margin:0px 0px 0px 1.5em;padding:0px"><li style="margin:0px;padding:0px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">We generated a manually censored public dataset of spam/vandalism/attack pages[3].  This will help others to develop spam, vandalism and attack page detection models.  See the publication of the dataset[4].</span></li></ul></div><div id="gmail-magicdomid3059" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><ul class="gmail-list-bullet1" style="margin:0px 0px 0px 1.5em;padding:0px"><li style="margin:0px;padding:0px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">We've implement color-based confidence reporting for ORES damage detection[5]</span></li></ul></div><div id="gmail-magicdomid1971" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><br style="margin:0px;padding:0px"></div><div id="gmail-magicdomid3064" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z gmail-b" style="margin:0px;padding:1px 0px"><b style="margin:0px;padding:0px">Maintenance and robustness:</b></span></div><div id="gmail-magicdomid3080" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><ul class="gmail-list-bullet1" style="margin:0px 0px 0px 1.5em;padding:0px"><li style="margin:0px;padding:0px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">We updated the version of OOjs-UI that gets bundled with Wiki labels[6] and moved the static assets to a new repositiory[7]</span></li></ul></div><div id="gmail-magicdomid3093" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><ul class="gmail-list-bullet1" style="margin:0px 0px 0px 1.5em;padding:0px"><li style="margin:0px;padding:0px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">We fixed an issue in the recscoring library[8] that caused ORES to return invalid JSON and rendered the UI useless[9].  </span></li></ul></div><div id="gmail-magicdomid1167" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><br style="margin:0px;padding:0px"></div><div id="gmail-magicdomid3063" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z gmail-b" style="margin:0px;padding:1px 0px"><b style="margin:0px;padding:0px">Communications:</b></span></div><div id="gmail-magicdomid3039" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><ul class="gmail-list-bullet1" style="margin:0px 0px 0px 1.5em;padding:0px"><li style="margin:0px;padding:0px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">We gave a 3 minute presentation on the state of ORES to Victoria Coleman, the WMF's new CTO[10].</span></li></ul></div><div id="gmail-magicdomid3040" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><ul class="gmail-list-bullet1" style="margin:0px 0px 0px 1.5em;padding:0px"><li style="margin:0px;padding:0px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">We performed a basic analysis of Wikipedia article quality trends using the dataset we released a few weeks ago[11].  We'll have a more substantial analysis soon.</span></li></ul></div><div id="gmail-magicdomid3041" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><ul class="gmail-list-bullet1" style="margin:0px 0px 0px 1.5em;padding:0px"><li style="margin:0px;padding:0px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">We made a post on the ORES review tool talk page[12,13] detailing how we plan to incorporate a new filtering strategy into the ORES review tool.  Please join the discussion there.</span></li></ul></div><div id="gmail-magicdomid1972" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><br style="margin:0px;padding:0px"></div><div id="gmail-magicdomid1973" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">1. </span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z gmail-url" style="margin:0px;padding:1px 0px"><a href="https://phabricator.wikimedia.org/T150224" style="margin:0px;padding:0px;white-space:pre-wrap">https://phabricator.wikimedia.org/T150224</a></span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px"> -- Add "Lowest" ORES sensitivity for fpr=0.1</span></div><div id="gmail-magicdomid1974" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">2. </span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z gmail-url" style="margin:0px;padding:1px 0px"><a href="https://phabricator.wikimedia.org/T151119" style="margin:0px;padding:0px;white-space:pre-wrap">https://phabricator.wikimedia.org/T151119</a></span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px"> -- Apply ui standardization color palette to Wikilabels</span></div><div id="gmail-magicdomid1975" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">3. </span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z gmail-url" style="margin:0px;padding:1px 0px"><a href="https://phabricator.wikimedia.org/T150307" style="margin:0px;padding:0px;white-space:pre-wrap">https://phabricator.wikimedia.org/T150307</a></span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px"> -- Create manually vetted dataset of spam/vandalism/attack pages</span></div><div id="gmail-magicdomid1976" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">4. </span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z gmail-url" style="margin:0px;padding:1px 0px"><a href="https://dx.doi.org/10.6084/m9.figshare.4245035" style="margin:0px;padding:0px;white-space:pre-wrap">https://dx.doi.org/10.6084/m9.figshare.4245035</a></span></div><div id="gmail-magicdomid2392" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">5. </span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z gmail-url" style="margin:0px;padding:1px 0px"><a href="https://phabricator.wikimedia.org/T144922" style="margin:0px;padding:0px;white-space:pre-wrap">https://phabricator.wikimedia.org/T144922</a></span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px"> -- Visually report damaging confidence</span></div><div id="gmail-magicdomid2388" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">6. </span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z gmail-url" style="margin:0px;padding:1px 0px"><a href="https://phabricator.wikimedia.org/T151222" style="margin:0px;padding:0px;white-space:pre-wrap">https://phabricator.wikimedia.org/T151222</a></span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px"> -- Update bundled OOJS-ui with Wikilabels</span></div><div id="gmail-magicdomid2389" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">7. </span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z gmail-url" style="margin:0px;padding:1px 0px"><a href="https://github.com/wiki-ai/flask-oojsui" style="margin:0px;padding:0px;white-space:pre-wrap">https://github.com/wiki-ai/flask-oojsui</a></span></div><div id="gmail-magicdomid2390" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">8. </span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z gmail-url" style="margin:0px;padding:1px 0px"><a href="https://phabricator.wikimedia.org/T150961" style="margin:0px;padding:0px;white-space:pre-wrap">https://phabricator.wikimedia.org/T150961</a></span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px"> -- ORES ui is broken (text field disabled)</span></div><div id="gmail-magicdomid3047" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">9. </span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z gmail-url" style="margin:0px;padding:1px 0px"><a href="https://github.com/wiki-ai/ores/issues/177" style="margin:0px;padding:0px;white-space:pre-wrap">https://github.com/wiki-ai/ores/issues/177</a></span></div><div id="gmail-magicdomid3043" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">10. </span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z gmail-url" style="margin:0px;padding:1px 0px"><a href="https://phabricator.wikimedia.org/T150544" style="margin:0px;padding:0px;white-space:pre-wrap">https://phabricator.wikimedia.org/T150544</a></span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px"> -- ORES (a 2-3 minute presentation)</span></div><div id="gmail-magicdomid3044" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">11. </span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z gmail-url" style="margin:0px;padding:1px 0px"><a href="https://phabricator.wikimedia.org/T151214" style="margin:0px;padding:0px;white-space:pre-wrap">https://phabricator.wikimedia.org/T151214</a></span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px"> -- Basic analysis of Wikipedia quality using monthly predictions</span></div><div id="gmail-magicdomid3045" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">12. </span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z gmail-url" style="margin:0px;padding:1px 0px"><a href="https://phabricator.wikimedia.org/T150858" style="margin:0px;padding:0px;white-space:pre-wrap">https://phabricator.wikimedia.org/T150858</a></span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px"> -- Post about ORES review tool including ERI filters</span></div><div id="gmail-magicdomid3046" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:arial,sans-serif;font-size:12px"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">13. </span><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z gmail-url" style="margin:0px;padding:1px 0px"><a href="https://www.mediawiki.org/wiki/Topic:Tflhjj5x1numzg67" style="margin:0px;padding:0px;white-space:pre-wrap">https://www.mediawiki.org/wiki/Topic:Tflhjj5x1numzg67</a></span></div><div id="gmail-magicdomid940" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-size:12px;font-family:"helvetica neue",arial,sans-serif"><br style="margin:0px;padding:0px"></div><div id="gmail-magicdomid941" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-size:12px;font-family:"helvetica neue",arial,sans-serif"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">Sincerely, </span></div><div id="gmail-magicdomid942" class="gmail-ace-line" style="margin:0px;padding:0px;color:rgb(0,0,0);font-size:12px;font-family:"helvetica neue",arial,sans-serif"><span class="gmail-author-a-z68zb6oz84zz83z39z77zz88zz67z6z67zz70zz79zz77z" style="margin:0px;padding:1px 0px">Aaron from the Revision Scoring team</span></div></div>