Hi artificial intelligence people,
Are there baseline ORES scores available for articles? If so, I'm thinking
that it would be interesting to have the option to add a template to an
article's talk page that shows its ORES score as well as its ORES
percentile rank on a particular wiki.
Pine
Hey,
This is the (12 + 1)th [1] weekly update from revision scoring team that we
have sent to this mailing list.
New developments:
- ORES review tool is deployed as a beta feature in Turkish Wikipedia.
Now six Wikis have this tool. [2]
- CopyPatrol tool soon will show ORES scores if they pass a certain
threshold. [3]
- We are talking about integration with Detox, feel free to chime in. [4]
Maintenance and robustness:
- Currently we are dealing with increasing memory pressure on scb nodes.
Actions we did to reduce this pressure:
- We migrated most of RandomForrest models to GradientBoosting, which
will reduce memory pressure greatly without affecting accuracy of models
noticeably [5]
- It seems there is a memory leak issue with celery. We bypassed that by
setting a periodic restart of workers. [6]
- We reduced maximum number of precaching requests in order to prevent
spikes that might cause memory pressure on other services. [7]
- We reduced number of web processes to 2/3. It is still fine. [8]
- We finished up the refactor and it will soon goes to the production
cluster. [9]
- Damaging and goodfaith models had issue in Dutch Wikipedia. Got fixed.
[10]
- Our metrics collector now sends timed requests. We will have a
dashboard in grafana for that soon. [11]
- There will be a link to "ORES review tool" page [12] in legend of
RecentChanges and Watchlist. [13]
- When revscoring fails for any unknown reason, ORES return a proper
message now. [14]
- We fixed a puppet issue that caused trouble while creating new web
instances. Got fixed [15]
1. It's 13. We are not superstitious, just kidding ;)
2. https://phabricator.wikimedia.org/T139992
3. https://phabricator.wikimedia.org/T139009
4. https://phabricator.wikimedia.org/T139007
5. https://phabricator.wikimedia.org/T139963
6. https://phabricator.wikimedia.org/T140020
7. https://gerrit.wikimedia.org/r/299559
8. https://gerrit.wikimedia.org/r/298739
9. https://github.com/wiki-ai/ores/pull/155
10. https://phabricator.wikimedia.org/T140038
11. https://phabricator.wikimedia.org/T137442
12. https://www.mediawiki.org/wiki/ORES_review_tool
13. https://phabricator.wikimedia.org/T140361
14. https://phabricator.wikimedia.org/T140301
15. https://phabricator.wikimedia.org/T140265
Sincerely,
Amir from the Revision Scoring team
Hey,
This is the 11th weekly update from revision scoring team that we have sent
to this mailing list.
*New developments:*
- ORES review tool as a beta feature is enabled in Dutch Wikipedia. More
wikis to come soon this week [1].
- We have basic edit quality model for Czech Wikipedia ready and merged.
To be deployed this week [2].
- We also have basic models for English Wiktionary too. This is the
second non-Wikipedia project we support after Wikidata [3].
- Thanks to Tar Lócesilion, we have Polish edit quality campaign
completed, We are working on building damaging and goodfaith models at the
moment [4].
*Maintenance and robustness:*
- We decreased our web capacity in order to reduce memory pressure on
scb nodes. You should not get any overload error since our capacity is
still very high but if you do, please contact us immediately and we will
bring it back up [5].
- We improved documentation on ores.wikimedia.org page a little bit. To
be deployed this week [6].
We are working on a rather big refactor on ores which will give us
performance boost on scoring multiple models at the same time [7] and
reduce memory usage [8]. Feel free to chime in and give us feedback [9].
1. https://phabricator.wikimedia.org/T139432
2. https://phabricator.wikimedia.org/T138885
3. https://phabricator.wikimedia.org/T138630
4. https://phabricator.wikimedia.org/T130269
5. https://phabricator.wikimedia.org/T139177
6. https://phabricator.wikimedia.org/T138089
7. https://phabricator.wikimedia.org/T134606
8. https://phabricator.wikimedia.org/T139407
9. https://phabricator.wikimedia.org/T139408
Sincerely,
Amir from the Revision Scoring team.