The fuck AI request, be transparent
On Nov 30, 2016 2:00 PM, <ai-request(a)lists.wikimedia.org> wrote:
Send AI mailing list submissions to
ai(a)lists.wikimedia.org
To subscribe or unsubscribe via the World Wide Web, visit
https://lists.wikimedia.org/mailman/listinfo/ai
or, via email, send a message with subject or body 'help' to
ai-request(a)lists.wikimedia.org
You can reach the person managing the list at
ai-owner(a)lists.wikimedia.org
When replying, please edit your Subject line so it is more specific
than "Re: Contents of AI digest..."
Today's Topics:
1. The Revision scoring weekly update (Aaron Halfaker)
----------------------------------------------------------------------
Message: 1
Date: Tue, 29 Nov 2016 18:34:11 -0500
From: Aaron Halfaker <aaron.halfaker(a)gmail.com>
To: Application of Artificial Intelligence and other advanced
computing strategies to Wikimedia Projects <ai(a)lists.wikimedia.org
,
Wikimedia developers
<wikitech-l(a)lists.wikimedia.org>
Subject: [AI] The Revision scoring weekly update
Message-ID:
<CANQe2T_GAqzZYraq7vm+WcSZi+x-1p7K_HP1PTvYgjEUY4_OrQ@mail.
gmail.com>
Content-Type: text/plain; charset="utf-8"
Hey,
This is the 30th and 31st weekly update from the revision scoring team that
we have sent to this mailing list. We accidentally skipped a week again.
*New development:*
- We added a new "lowest" sensitivity level to ORES review tool. This
new sensistivity level will only flag edits that ORES is very confident
are
actually damaging[1].
- We applied the MediaWiki standard color palette to Wikilabels[2]
- We generated a manually censored public dataset of
spam/vandalism/attack pages[3]. This will help others to develop spam,
vandalism and attack page detection models. See the publication of the
dataset[4].
- We've implement color-based confidence reporting for ORES damage
detection[5]
*Maintenance and robustness:*
- We updated the version of OOjs-UI that gets bundled with Wiki
labels[6] and moved the static assets to a new repositiory[7]
- We fixed an issue in the recscoring library[8] that caused ORES to
return invalid JSON and rendered the UI useless[9].
*Communications:*
- We gave a 3 minute presentation on the state of ORES to Victoria
Coleman, the WMF's new CTO[10].
- We performed a basic analysis of Wikipedia article quality trends
using the dataset we released a few weeks ago[11]. We'll have a more
substantial analysis soon.
- We made a post on the ORES review tool talk page[12,13] detailing how
we plan to incorporate a new filtering strategy into the ORES review
tool.
Please join the discussion there.
1.
https://phabricator.wikimedia.org/T150224 -- Add "Lowest" ORES
sensitivity for fpr=0.1
2.
https://phabricator.wikimedia.org/T151119 -- Apply ui standardization
color palette to Wikilabels
3.
https://phabricator.wikimedia.org/T150307 -- Create manually vetted
dataset of spam/vandalism/attack pages
4.
https://dx.doi.org/10.6084/m9.figshare.4245035
5.
https://phabricator.wikimedia.org/T144922 -- Visually report damaging
confidence
6.
https://phabricator.wikimedia.org/T151222 -- Update bundled OOJS-ui
with
Wikilabels
7.
https://github.com/wiki-ai/flask-oojsui
8.
https://phabricator.wikimedia.org/T150961 -- ORES ui is broken (text
field disabled)
9.
https://github.com/wiki-ai/ores/issues/177
10.
https://phabricator.wikimedia.org/T150544 -- ORES (a 2-3 minute
presentation)
11.
https://phabricator.wikimedia.org/T151214 -- Basic analysis of
Wikipedia quality using monthly predictions
12.
https://phabricator.wikimedia.org/T150858 -- Post about ORES review
tool including ERI filters
13.
https://www.mediawiki.org/wiki/Topic:Tflhjj5x1numzg67
Sincerely,
Aaron from the Revision Scoring team