Hey,
For patrolling work, ORES usually has two levels of support:
- For basic support we usually provide a model that is called 'reverted'
and has less accuracy. It also risks perpetuating editor biases due to the
lack of differentiation between reasons that a change may have been
reverted.
- For advanced support, we require manual labeling of a large sample of
edits, but then we can provide two more models: 'damaging' and 'goodfaith'.
ORES review tool can only be enabled on wikis where advanced support is
available and most other tools prefer the 'damaging' over the basic
'reverted' model as well.
So, for performance and capacity reasons we think it makes sense to remove
'reverted' models from the ORES service when 'damaging' model is made
available. However, we also want to be careful about making sure this
change doesn't disrupt the work of tool developers that make use of the
ORES service.
If you do, please voice your concerns now. If there is no objection within
the next two weeks, we'll begin the process of removing the 'reverted'
model for wikis that have the 'damaging' model available.
Related phabricator card: https://phabricator.wikimedia.org/T171059
Best
--
Amir Sarabadani Tafreshi
Software Engineer (contractor)
-------------------------------------
Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
http://wikimedia.de
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/681/51985.
Hey folks,
This is a little overdue, but I wanted to work with comms to craft a blog
post that would help us do a bit of outreach around the announcement of the
team. That just went live.
See https://blog.wikimedia.org/2017/07/19/scoring-platform-team/
-Aaron
Principal research scientist
Lead of the Scoring Platform team
Wikimedia Foundation
Friends,
This is a Scoring Platform technical update for the last couple of weeks of
work.
*Deployments*
We completed a biweekly deployment today, adding models for quite a few new
wikis. Congratulations, and a big thank you to everyone who helped us
coordinate and gather the data to accomplish this!
Epic: https://phabricator.wikimedia.org/T170485
*New models*
- Albanian Wikipedia: new models for reverted, damaging, and goodfaith.
- Bengali Wikipedia: new model for reverted.
- Greek Wikipedia: new model for reverted.
- Tamil Wikipedia: new model for reverted.
- Romanian Wikipedia: new models for damaging and goodfaith.
- Turkish Wikipedia: fixes to the article quality model ("wp10") (
https://phabricator.wikimedia.org/T170838 )
*Service updates*
- Switched precaching from RCStream (deprecated) to new EventStreams,
https://phabricator.wikimedia.org/T166046
- Better error handling for bad API params,
https://phabricator.wikimedia.org/T168920
- Patched a DoS caused by a combination of bad regex and inadequate
timeout code. Incident:
https://wikitech.wikimedia.org/wiki/Incident_documentation/20170623-ORES
Note that Albanian and Romanian Wikipedias will soon support ORES in their
Recent Changes feeds. Subscribe to
https://phabricator.wikimedia.org/T170723 for updates.
Regards,
Adam