AI July 2016

ai@lists.wikimedia.org

2 participants
5 discussions

ORES article scores
by Pine W 04 Sep '16

04 Sep '16

Hi artificial intelligence people, Are there baseline ORES scores available for articles? If so, I'm thinking that it would be interesting to have the option to add a template to an article's talk page that shows its ORES score as well as its ORES percentile rank on a particular wiki. Pine

2 12

The Revision Scoring weekly update
by Amir Ladsgroup 26 Jul '16

26 Jul '16

Hey, This is the 14th weekly update from revision scoring team that we have sent to this mailing list. New developments: - We have a new grafana dashboard for requests that the ORES beta feature makes [1] [2] - There is a grafana chart in ORES service showing total number of requests (including requests hitting cache). Showing we had 20 million requests last month! [3] - ORES extension can be set to score edits only in a given set of namespaces. This was useful to reduce failure rate of jobs in ORES extension from 4% to 1% [4] - Scap3 now automatically deploys to canary node for ORES first (it's scb2001.codfw.wmnet). So we can better test deployments beforehand. [5] Maintenance and robustness: - We are removing a redundant index on ores_classification. No harm would be made but we'll save disk space. [6] - In footer of ores.wikimedia.org, we had "Hosted in Wikimedia Labs". It got fixed now. [7] - Cache.php in ORES extension which stores the scores into database has a better structure for handling errors.[8] 1. https://phabricator.wikimedia.org/T141169 2. https://grafana.wikimedia.org/dashboard/db/ores-extension 3. https://grafana.wikimedia.org/dashboard/db/ores 4. https://phabricator.wikimedia.org/T139660 5. https://phabricator.wikimedia.org/T139825 6. https://phabricator.wikimedia.org/T140803 7. https://phabricator.wikimedia.org/T139028 8. https://phabricator.wikimedia.org/T137880 Sincerely, Amir from the Revision Scoring team

1 0

The Revision Scoring weekly update
by Amir Ladsgroup 18 Jul '16

18 Jul '16

Hey, This is the (12 + 1)th [1] weekly update from revision scoring team that we have sent to this mailing list. New developments: - ORES review tool is deployed as a beta feature in Turkish Wikipedia. Now six Wikis have this tool. [2] - CopyPatrol tool soon will show ORES scores if they pass a certain threshold. [3] - We are talking about integration with Detox, feel free to chime in. [4] Maintenance and robustness: - Currently we are dealing with increasing memory pressure on scb nodes. Actions we did to reduce this pressure: - We migrated most of RandomForrest models to GradientBoosting, which will reduce memory pressure greatly without affecting accuracy of models noticeably [5] - It seems there is a memory leak issue with celery. We bypassed that by setting a periodic restart of workers. [6] - We reduced maximum number of precaching requests in order to prevent spikes that might cause memory pressure on other services. [7] - We reduced number of web processes to 2/3. It is still fine. [8] - We finished up the refactor and it will soon goes to the production cluster. [9] - Damaging and goodfaith models had issue in Dutch Wikipedia. Got fixed. [10] - Our metrics collector now sends timed requests. We will have a dashboard in grafana for that soon. [11] - There will be a link to "ORES review tool" page [12] in legend of RecentChanges and Watchlist. [13] - When revscoring fails for any unknown reason, ORES return a proper message now. [14] - We fixed a puppet issue that caused trouble while creating new web instances. Got fixed [15] 1. It's 13. We are not superstitious, just kidding ;) 2. https://phabricator.wikimedia.org/T139992 3. https://phabricator.wikimedia.org/T139009 4. https://phabricator.wikimedia.org/T139007 5. https://phabricator.wikimedia.org/T139963 6. https://phabricator.wikimedia.org/T140020 7. https://gerrit.wikimedia.org/r/299559 8. https://gerrit.wikimedia.org/r/298739 9. https://github.com/wiki-ai/ores/pull/155 10. https://phabricator.wikimedia.org/T140038 11. https://phabricator.wikimedia.org/T137442 12. https://www.mediawiki.org/wiki/ORES_review_tool 13. https://phabricator.wikimedia.org/T140361 14. https://phabricator.wikimedia.org/T140301 15. https://phabricator.wikimedia.org/T140265 Sincerely, Amir from the Revision Scoring team

1 0

The Revision Scoring weekly update
by Amir Ladsgroup 11 Jul '16

11 Jul '16

Hey, This is the 12th weekly update from revision scoring team that we have sent to this mailing list. New developments: - We deployed ORES review tool in Russian and Portuguese Wikipedia! [1] [2] - Basic support for English Wiktionary and Czech Wikipedia is live in labs.[3] Soon production will follow. - Damaging model for Polish Wikipedia is ready and soon be available (then we can enable ORES review tool as well) [4] - ORES extension now highlights the whole row for Enhanced recent changes too. It will be live in two weeks [5] - We built prototype of a small web app to show progress of wikilabels campaigns at https://tools.wmflabs.org/dexbot/tools/wikilabels_stats.php. Feedback is welcome [6] Maintenance and robustness: - If a web node goes down in labs, we get icigna warnings [7] - We re-launched wikilabels campaigns for French and Azeri Wikipedia [8] [9] - We are starting to use tsv2json to load the whole data when adding new campaigns in wikilabels [10] - "Hide/Show good edits" soon will be changed to "Hide/Show probably good edits" in recent changes and watchlists to reflect ORES scores more accurately [11] 1. https://phabricator.wikimedia.org/T139541 2. https://phabricator.wikimedia.org/T139692 3. https://phabricator.wikimedia.org/T139789 4. https://phabricator.wikimedia.org/T139207 5. https://phabricator.wikimedia.org/T139924 6. https://phabricator.wikimedia.org/T139874 7. https://phabricator.wikimedia.org/T134782 8. https://phabricator.wikimedia.org/T107730 9. https://phabricator.wikimedia.org/T139875 10. https://phabricator.wikimedia.org/T139939 11. https://phabricator.wikimedia.org/T139754 Sincerely, Amir from the Revision Scoring team

1 0

The Revision Scoring weekly update
by Amir Ladsgroup 06 Jul '16

06 Jul '16

Hey, This is the 11th weekly update from revision scoring team that we have sent to this mailing list. *New developments:* - ORES review tool as a beta feature is enabled in Dutch Wikipedia. More wikis to come soon this week [1]. - We have basic edit quality model for Czech Wikipedia ready and merged. To be deployed this week [2]. - We also have basic models for English Wiktionary too. This is the second non-Wikipedia project we support after Wikidata [3]. - Thanks to Tar Lócesilion, we have Polish edit quality campaign completed, We are working on building damaging and goodfaith models at the moment [4]. *Maintenance and robustness:* - We decreased our web capacity in order to reduce memory pressure on scb nodes. You should not get any overload error since our capacity is still very high but if you do, please contact us immediately and we will bring it back up [5]. - We improved documentation on ores.wikimedia.org page a little bit. To be deployed this week [6]. We are working on a rather big refactor on ores which will give us performance boost on scoring multiple models at the same time [7] and reduce memory usage [8]. Feel free to chime in and give us feedback [9]. 1. https://phabricator.wikimedia.org/T139432 2. https://phabricator.wikimedia.org/T138885 3. https://phabricator.wikimedia.org/T138630 4. https://phabricator.wikimedia.org/T130269 5. https://phabricator.wikimedia.org/T139177 6. https://phabricator.wikimedia.org/T138089 7. https://phabricator.wikimedia.org/T134606 8. https://phabricator.wikimedia.org/T139407 9. https://phabricator.wikimedia.org/T139408 Sincerely, Amir from the Revision Scoring team.

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

AI July 2016