Hey,
This is the 29th weekly update from revision scoring team that we have sent
to this mailing list.
Deployments:
- We deployed logging changes to ORES that will reduce the verbosity[1]
- We also deployed revscoring 1.3.0 and new models built with it to WMF
labs[2]. This won't change anything important from a user-perspective, but
it paves the way for developing new modeling strategies.
Maintenance and robustness:
- We fixed puppet so that log file directories are also created on the
celery worker nodes (affects wmflabs)[3]
- We fixed an issue with our recall_at_fpr metrics which was incorrectly
defined and implemented a recall_at_precision metric to take its place[4]
New development:
- We've made a lot of progress on modeling sentences and have just
started experimenting with a sentence model from featured articles[5]
- We're reviewing a dataset of spam/vandalism/attack new page creations
for public release[6]. This dataset will help our collaborators work with
us on modeling the quality of drafts and supporting new page triage.
1.
https://phabricator.wikimedia.org/T149730 -- Deploy logging changes to
ORES
2.
https://phabricator.wikimedia.org/T150447 -- Deploy revscoring 1.3.0 and
updated editquality and wikiclass to wmflabs
3.
https://phabricator.wikimedia.org/T149925 -- /srv/log/ores/ not created
on worker nodes
4.
https://phabricator.wikimedia.org/T149825 -- Implement recall at
precision (and fix FPR metrics)
5.
https://phabricator.wikimedia.org/T148867 -- Implement sentences
datascources & experiment with normalization.
6.
https://phabricator.wikimedia.org/T150307 -- Create manually vetted
dataset of spam/vandalism/attack pages
Sincerely,
Aaron from the Revision Scoring team