Hey,

This is the 30th and 31st weekly update from the revision scoring team that we have sent to this mailing list. We accidentally skipped a week again.

*New development:*

- We added a new "lowest" sensitivity level to ORES review tool. This new sensistivity level will only flag edits that ORES is very confident are actually damaging[1].

- We applied the MediaWiki standard color palette to Wikilabels[2]

- We generated a manually censored public dataset of spam/vandalism/attack pages[3]. This will help others to develop spam, vandalism and attack page detection models. See the publication of the dataset[4].

- We've implement color-based confidence reporting for ORES damage detection[5]

*Maintenance and robustness:*

- We updated the version of OOjs-UI that gets bundled with Wiki labels[6] and moved the static assets to a new repositiory[7]

- We fixed an issue in the recscoring library[8] that caused ORES to return invalid JSON and rendered the UI useless[9].

*Communications:*

- We gave a 3 minute presentation on the state of ORES to Victoria Coleman, the WMF's new CTO[10].

- We performed a basic analysis of Wikipedia article quality trends using the dataset we released a few weeks ago[11]. We'll have a more substantial analysis soon.

- We made a post on the ORES review tool talk page[12,13] detailing how we plan to incorporate a new filtering strategy into the ORES review tool. Please join the discussion there.

1. https://phabricator.wikimedia.org/T150224 -- Add "Lowest" ORES sensitivity for fpr=0.1 2. https://phabricator.wikimedia.org/T151119 -- Apply ui standardization color palette to Wikilabels 3. https://phabricator.wikimedia.org/T150307 -- Create manually vetted dataset of spam/vandalism/attack pages 4. https://dx.doi.org/10.6084/m9.figshare.4245035 5. https://phabricator.wikimedia.org/T144922 -- Visually report damaging confidence 6. https://phabricator.wikimedia.org/T151222 -- Update bundled OOJS-ui with Wikilabels 7. https://github.com/wiki-ai/flask-oojsui 8. https://phabricator.wikimedia.org/T150961 -- ORES ui is broken (text field disabled) 9. https://github.com/wiki-ai/ores/issues/177 10. https://phabricator.wikimedia.org/T150544 -- ORES (a 2-3 minute presentation) 11. https://phabricator.wikimedia.org/T151214 -- Basic analysis of Wikipedia quality using monthly predictions 12. https://phabricator.wikimedia.org/T150858 -- Post about ORES review tool including ERI filters 13. https://www.mediawiki.org/wiki/Topic:Tflhjj5x1numzg67

Sincerely, Aaron from the Revision Scoring team