The Revision Scoring weekly update - AI

18 Jul 2016


      Hey,
This is the (12 + 1)th [1] weekly update from revision scoring team that we
have sent to this mailing list.
New developments:
- ORES review tool is deployed as a beta feature in Turkish Wikipedia.
   Now six Wikis have this tool. [2]
- CopyPatrol tool soon will show ORES scores if they pass a certain
   threshold. [3]
- We are talking about integration with Detox, feel free to chime in. [4]
Maintenance and robustness:
- Currently we are dealing with increasing memory pressure on scb nodes.
   Actions we did to reduce this pressure:
- We migrated most of RandomForrest models to GradientBoosting, which
   will reduce memory pressure greatly without affecting accuracy of models
   noticeably [5]
- It seems there is a memory leak issue with celery. We bypassed that by
   setting a periodic restart of workers. [6]
- We reduced maximum number of precaching requests in order to prevent
   spikes that might cause memory pressure on other services. [7]
- We reduced number of web processes to 2/3. It is still fine. [8]
- We finished up the refactor and it will soon goes to the production
   cluster. [9]
- Damaging and goodfaith models had issue in Dutch Wikipedia. Got fixed.
   [10]
- Our metrics collector now sends timed requests. We will have a
   dashboard in grafana for that soon. [11]
- There will be a link to "ORES review tool" page [12] in legend of
   RecentChanges and Watchlist. [13]
- When revscoring fails for any unknown reason, ORES return a proper
   message now. [14]
- We fixed a puppet issue that caused trouble while creating new web
   instances. Got fixed [15]
1. It's 13. We are not superstitious, just kidding ;)
2. https://phabricator.wikimedia.org/T139992
3. https://phabricator.wikimedia.org/T139009
4. https://phabricator.wikimedia.org/T139007
5. https://phabricator.wikimedia.org/T139963
6. https://phabricator.wikimedia.org/T140020
7. https://gerrit.wikimedia.org/r/299559
8. https://gerrit.wikimedia.org/r/298739
9. https://github.com/wiki-ai/ores/pull/155
10. https://phabricator.wikimedia.org/T140038
11. https://phabricator.wikimedia.org/T137442
12. https://www.mediawiki.org/wiki/ORES_review_tool
13. https://phabricator.wikimedia.org/T140361
14. https://phabricator.wikimedia.org/T140301
15. https://phabricator.wikimedia.org/T140265
Sincerely,
Amir from the Revision Scoring team