The Revision Scoring weekly update - Wikitech-l

9 Aug 2016


      Hey folks,
This is the 16th weekly update from revision scoring team that we have sent
to this mailing list.
New developments:
- We created dashboards for the ORES service in the Beta cluster[1] and
   created panes for tracking failed jobs[2].
- We extended the documentation for the ORES review tool[3,4]
Maintenance:
- We did some work to make the Beta cluster look more like production so
   that we can do better testing before the next deployment
- We set up a password on the Beta redis server[5]
- We configured the Beta ORES extension to actually use the Beta ORES
   service[6]
- We also prepared a set of puppet changes for the deployment of a
   refactored version of ORES to production[7]
Issues in WMFLabs
- We investigated a series of timeout errors that were appearing in the
   logs[8]
- We investigated a periodic redis-related error that shower up when
   scoring edits[9]
- We fixed our "05" web node that was periodically running out of
   memory[10]
Estimating future resource needs
- In preparation for buying new hardware, we measured our past memory
   usage and extrapolated forward two years to estimate what hardware
   requirements we'll have[11]
1. https://phabricator.wikimedia.org/T142294 - Dashboard or pane for
   ORES service in beta
1. https://phabricator.wikimedia.org/T142119 - Dashboard or pane for
   ORES failed jobs on beta
1. https://phabricator.wikimedia.org/T140150 - Make user-centered
   documentation for review tool
1. https://www.mediawiki.org/wiki/ORES_review_tool
1. https://phabricator.wikimedia.org/T141823 - Set up password on ORES
   Beta redis server
1. https://phabricator.wikimedia.org/T141825 - Config beta ORES
   extension to use the beta ORES service
1. https://phabricator.wikimedia.org/T141575 - Puppet config changes for
   ORES refactor
1. https://phabricator.wikimedia.org/T141368 - [Investigate] ORES time
   out errors in logs
1. https://phabricator.wikimedia.org/T141946 - [Investigate] Periodic
   redis related errors in wmflabs
1. https://phabricator.wikimedia.org/T141523 - [Investigate] web-05
   downtime
1. https://phabricator.wikimedia.org/T142046 - Extrapolate memory usage
   per worker forward 2 years
Sincerely,
Aaron from the Revision Scoring team