AI June 2016

ai@lists.wikimedia.org

3 participants
6 discussions

The revision scoring weekly update
by Amir Ladsgroup 28 Jun '16

28 Jun '16

Hey all, This is the 10th weekly update (yay!) from revision scoring team that we have sent to this mailing list. We had Wikimania so it was a busy week. Sessions: - Lessons Learned building machine models for Wikidata [1] Video [2] Slides [3] - Hackathon: Supporting new languages in ORES [4] Video [5] New developments: - Thanks to the services team, we now use ChangePropagation for precaching [6] - New version of ORES is deployed in so new edit quality models (svwiki and nowiki) and article quality models (ruwiki) and other new deployments are now live. Labs: [7] Prod [8] - ores in beta cluster is live again with the exact same settings as prod so we can test more carefully [9] - We launched edit quality campaign for Swedish Wikipedia [10] - Thanks to Daniel Zahn, we have monitoring for worker nodes in production cluster [11] - Our precached daemon in labs now support omitting bot edits [12] - Revscoring supports Czech language, allow us enabling basic support for cswiki soon. [13] Maintenance and robustness: - We shipped all of GUI dependencies including Swagger, Wikimedia UI and bootstrap to ORES itself [14] - Fixed Swagger specs for better monitoring by Ops [15] - Fixed puppet issue with worker nodes in labs [16] - Wikilabels campaign in huwiki was broken. Got fixed [17] - URLs without trailing slash won't get redirected and just return the same response [18] - ores-wikimedia-config repo got renamed to ores-wmflabs-config to show the distinction better [19] - We improved some documentation with regard to deployment, in order to prevent down times [20] 1. https://phabricator.wikimedia.org/T138351 2. https://www.youtube.com/watch?v=dPs1evXFZa0 3. https://commons.wikimedia.org/wiki/File:Lessons_learned_building_machine_le… 4. https://phabricator.wikimedia.org/T134628 5. https://www.youtube.com/watch?v=WnM5Ys2-Cb8 6. https://phabricator.wikimedia.org/T138090 7. https://phabricator.wikimedia.org/T137828 8. https://phabricator.wikimedia.org/T138863 9. https://phabricator.wikimedia.org/T138445 10. https://phabricator.wikimedia.org/T131451 11. https://phabricator.wikimedia.org/T138882 12. https://phabricator.wikimedia.org/T137967 13. https://phabricator.wikimedia.org/T131637 14. https://phabricator.wikimedia.org/T137362 15. https://phabricator.wikimedia.org/T137804 16. https://phabricator.wikimedia.org/T137813 17. https://phabricator.wikimedia.org/T138576 18. https://phabricator.wikimedia.org/T138682 19. https://phabricator.wikimedia.org/T138253 20. https://phabricator.wikimedia.org/T138234 Sinceraly Amir from the Revision Scoring team

1 0

ORES going into production
by Aaron Halfaker 22 Jun '16

22 Jun '16

Hey folks, We (The Revision Scoring Team[1]) are happy to announce the deployment of the ORES service[2] in production at a new address: https://ores.wikimedia.org. This will replace the old Wikimedia Labs address soon: https://ores.wmflabs.org. Along with this new location, we are running on more predictable infrastructure that will allow us to increase our uptime and to make the service available to MediaWiki and extensions directly. We've also begun deploying the ORES review tool[3] as a beta feature on Wikidata and Persian Wikipedia in order trial the fully integrated extension. Once enabled, the ORES review tool highlights edits that are likely to be damaging in Special:RecentChanges to help you prioritize your patrolling work. ORES is an experimental technology. We encourage you to take advantage of it but also to be skeptical of the predictions made. Please reach out to us with your questions and concerns. We'll soon begin to deploy the ORES review tool to more wikis. Next up are English, Portuguese, Russian, Dutch and Turkish Wikipedias. We can deploy to these wikis because those communities have completed Wiki labels[4] campaigns that help train ORES' classifiers to differentiate good-faith mistakes from vandalism. If you'd like to get the ORES review tool deployed in your wiki, please reach out to us for help setting up or completing a Wiki labels campaign on your local wiki. Wikimania participants can also attend our workshop[5] during the hackathon to get setting up ORES for your local wiki. Documentation: * https://www.mediawiki.org/wiki/ORES_review_tool * https://www.mediawiki.org/wiki/Extension:ORES * https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service Bugs & feature requests: https://phabricator.wikimedia.org/tag/revision-scoring-as-a-service-backlog/ IRC: #wikimedia-ai[6] 1. https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service#Team 2. https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service 3. https://www.mediawiki.org/wiki/ORES_review_tool 4. https://meta.wikimedia.org/wiki/Wiki_labels 5. https://phabricator.wikimedia.org/T134628 6. https://webchat.freenode.net/?channels=#wikimedia-ai Stay tuned for an update about deprecation of ores.wmflabs.org and announcements of support for new wikis. Please feel free to reach out to us with any questions/ideas. -Aaron

2 1

The revision scoring weekly update
by Aaron Halfaker 20 Jun '16

20 Jun '16

Hey folks, This is the 9th weekly update for the revision scoring team that we have sent to this mailing list. The biggest news is that we've officially deployed the ORES review tool[1] to Persian Wikipedia and Wikidata[2,9]. We'll be posting a more complete announcement to Wikitech-l soon. New developments: - We generalized how the wsgi and celery applications are configured[4] - We fixed the way Special:Contributions is rendered so that the ORES review tool can work better there[6] Maintenance and robustness: - We documented some downtime for the ORES production service[3] - We untangled and simplified our deployment repositories[5] - An issue with Wikilabels accepting too many labels for a single task is fixed[7] - We brought our deployment of ORES in the beta cluster closer to production[8] - We solved an issue with how the ORES extension populates scores[10] Amir will be hosting a workshop for extending ORES support at Wikimania. See https://phabricator.wikimedia.org/T134628 for more details. 1. https://www.mediawiki.org/wiki/ORES_review_tool 2. https://phabricator.wikimedia.org/T130210 3. https://phabricator.wikimedia.org/T138248 4. https://phabricator.wikimedia.org/T137820 5. https://phabricator.wikimedia.org/T137819 6. https://phabricator.wikimedia.org/T122537 7. https://phabricator.wikimedia.org/T131997 8. https://phabricator.wikimedia.org/T137821 9. https://phabricator.wikimedia.org/T130212 10. https://phabricator.wikimedia.org/T137854 -Aaron

1 0

Re: [AI] [Wikidata] ORES live as a beta feature on Wikidata
by Pine W 16 Jun '16

16 Jun '16

Lydia and Amir FTW. (There seems to be a pattern of good news from the Wikidata and ORES teams. I wonder if Team Practices could facilitate the replication of some of their methods!) Onward ho, Pine On Jun 16, 2016 10:14, "Lydia Pintscher" <Lydia.Pintscher(a)wikimedia.de> wrote: Hey folks :) Amir and other have worked hard over the past months to bring ORES to Wikidata. The goal is to use machine learning to make it easier to spot potentially bad edits. ORES is now available as a beta feature on Wikidata. Once you have enabled it you can see some edits in recent changes and watchlist will show up in a different color or have a little r in front of them. These edits are judged as potentially bad and should probably get more review. In your preferences you can adjust how harsh ORES should judge. You can also filter your watchlist/recent changes to only show potentially bad edits. Patrolled edits won't be shown as potentially bad. This should be a huge step towards making it easier to find and fight vandalism on Wikidata. Cheers Lydia -- Lydia Pintscher - http://about.me/lydia.pintscher Product Manager for Wikidata Wikimedia Deutschland e.V. Tempelhofer Ufer 23-24 10963 Berlin www.wikimedia.de Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 Nz. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/029/42207. _______________________________________________ Wikidata mailing list Wikidata(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

1 0

The revision scoring weekly update
by Amir Ladsgroup 14 Jun '16

14 Jun '16

Hi folks, This is the 8th weekly update for the revision scoring team that we have sent to this mailing list. *New developments:* - ORES extension got deployed in Persian Wikipedia. [1] Give it a try! [2] - Article quality model ("wp10" model) is now working for Russian Wikipedia. [3] It will be deployed this week - We deplyed article topic campaign for English Wikipedia [4] - ores.wikimedia.org does have a grafana dashboard now [5] *Maintenance and robustness:* - ORES icinga didn't work when workers were down[13], it got fixed [6] - We finished load testing ores.wikimedia.org and it was quite alright [7] [8] - CORS is moved to uwsgi level to it works in prod too [9] - Deploying new versions of ORES in prod and labs has a proper documentation page now [10] [11] - We had intermittent spikes of errored revisions, got it resolved [12] 1. https://phabricator.wikimedia.org/T130211 2. https://fa.wikipedia.org/wiki/Special:Preferences#mw-prefsection-betafeatur… 3. https://phabricator.wikimedia.org/T131635 4. https://phabricator.wikimedia.org/T137325 5. https://phabricator.wikimedia.org/T137367 6. https://phabricator.wikimedia.org/T137592 7. https://phabricator.wikimedia.org/T137365 8. https://phabricator.wikimedia.org/T137131 9. https://phabricator.wikimedia.org/T137433 10. https://phabricator.wikimedia.org/T137570 11. https://wikitech.wikimedia.org/wiki/Ores/Deployment 12. https://phabricator.wikimedia.org/T134109 13. https://wikitech.wikimedia.org/wiki/Incident_documentation/20160610-ORES Best, Amir

1 0

Revision scoring weekly update
by Amir Ladsgroup 07 Jun '16

07 Jun '16

Hey folks, This is the 7th weekly update for the revision scoring team that we have sent to this mailing list. *New developments:* - The production version of ORES (ores.wikimedia.org) is live! We are still testing and it might break sometimes. [1] - Norwegian basic support is completed. We deploy this very soon. [2] [3] - ores-experiment.wmflabs.org is a new setup to run experimental models. [4] - We implemented a demo of dependent task in celery, our distributed processing environment [5] which brings us closer to a key performance improvement [6] *Maintenance and robustness:* - We deprecated flower in favor of grafana ( https://grafana.wikimedia.org/dashboard/db/ores ) [7] - Intermittent performance issues with wikilabels are now solved [8] 1. https://phabricator.wikimedia.org/T106867 2. https://phabricator.wikimedia.org/T131856 3. https://phabricator.wikimedia.org/T131855 4. https://ores-experiment.wmflabs.org/ 5. https://phabricator.wikimedia.org/T136875 6. https://phabricator.wikimedia.org/T134606 7. https://phabricator.wikimedia.org/T137003 8. https://phabricator.wikimedia.org/T130872 Sincerly -Amir

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

AI June 2016