Hey,
This is the 30th and 31st weekly update from the revision scoring team that
we have sent to this mailing list. We accidentally skipped a week again.
*New development:*
- We added a new "lowest" sensitivity level to ORES review tool. This
new sensistivity level will only flag edits that ORES is very confident are
actually damaging[1].
- We applied the MediaWiki standard color palette to Wikilabels[2]
- We generated a manually censored public dataset of
spam/vandalism/attack pages[3]. This will help others to develop spam,
vandalism and attack page detection models. See the publication of the
dataset[4].
- We've implement color-based confidence reporting for ORES damage
detection[5]
*Maintenance and robustness:*
- We updated the version of OOjs-UI that gets bundled with Wiki
labels[6] and moved the static assets to a new repositiory[7]
- We fixed an issue in the recscoring library[8] that caused ORES to
return invalid JSON and rendered the UI useless[9].
*Communications:*
- We gave a 3 minute presentation on the state of ORES to Victoria
Coleman, the WMF's new CTO[10].
- We performed a basic analysis of Wikipedia article quality trends
using the dataset we released a few weeks ago[11]. We'll have a more
substantial analysis soon.
- We made a post on the ORES review tool talk page[12,13] detailing how
we plan to incorporate a new filtering strategy into the ORES review tool.
Please join the discussion there.
1.
https://phabricator.wikimedia.org/T150224 -- Add "Lowest" ORES
sensitivity for fpr=0.1
2.
https://phabricator.wikimedia.org/T151119 -- Apply ui standardization
color palette to Wikilabels
3.
https://phabricator.wikimedia.org/T150307 -- Create manually vetted
dataset of spam/vandalism/attack pages
4.
https://dx.doi.org/10.6084/m9.figshare.4245035
5.
https://phabricator.wikimedia.org/T144922 -- Visually report damaging
confidence
6.
https://phabricator.wikimedia.org/T151222 -- Update bundled OOJS-ui with
Wikilabels
7.
https://github.com/wiki-ai/flask-oojsui
8.
https://phabricator.wikimedia.org/T150961 -- ORES ui is broken (text
field disabled)
9.
https://github.com/wiki-ai/ores/issues/177
10.
https://phabricator.wikimedia.org/T150544 -- ORES (a 2-3 minute
presentation)
11.
https://phabricator.wikimedia.org/T151214 -- Basic analysis of
Wikipedia quality using monthly predictions
12.
https://phabricator.wikimedia.org/T150858 -- Post about ORES review
tool including ERI filters
13.
https://www.mediawiki.org/wiki/Topic:Tflhjj5x1numzg67
Sincerely,
Aaron from the Revision Scoring team