Between 31st July 2013 (00:00:00) and August 19th (@ 18:53:18)...
15089 of all mobile edits resulted in an error compared to 23455 successful edits (38544 edits in total)- that's a 39% error rate which is simply unacceptable. The breakdown of these errors is as follows. The most alarming is AbuseFilter - it is accounting for 72% of all editing errors, costing all of our projects a lot of edits.
This is simply unacceptable and I'm not sure how we go about addressing this problem. I struggle to believe that 28% of all edits on mobile by registered users are abuse...
==AbuseFilter (10842, 72% of all errors)== abusefilter-warning-removal 4332 abusefilter-disallowed 2939 abusefilter-warning-13 723 abusefilter-warning-all-categories-removed 668 abusefilter-warning-ref-group-blanking 504 abusefilter-warning 388 abusefilter-warning-blanking 323 abusefilter-warning-rimozione-categorie 277 abusefilter-warning-removal-of-categories 182 abusefilter-warning-leeghalen 57 abusefilter-warning-uncat 55 abusefilter-warning-kategorilerinçıkarılması 43 abusefilter-warning-removing-information-template 41 abusefilter-warning-no-lead-section 35 abusefilter-warning-usuwanie-tekstu 34 Misbruikfilter-waarschuwing-categorie 29 abusefilter-warning-usuwanie-kategorii 17 abusefilter-warning-repeated-characters 17 abusefilter-warning-removal-cat 16 abusefilter-warning-kategorie 13 abusefilter-warning-17 12 abusefilter-blanking 10 abusefilter-warning-AFC 10 abusefilter-warning-vyprázdnění 8 abusefilter-warning-lowercase-letters 8 abusefilter-warning-shouting 6 abusefilter-warning-removal-of-templates 6 abusefilter-warning-email 6 abusefilter-blank 5 abusefilter-warning-large-nonenglish-addition 4 abusefilter-warning-short-new-article 4 abusefilter-warning-veryshortarticle 4 abusefilter-warning-nowiki 3 abusefilter-warning-používaná 3 abusefilter-warning-special-templates-removal 3 abusefilter-warning-largeaddition-notice 3 abusefilter-warning-nospaces 3 abusefilter-warning-talkblanking 3 abusefilter-warning-external-images 3 abusefilter-warning-8 3 abusefilter-warning-clear-page 2 abusefilter-warning-1 2 abusefilter-warning-badlang 2 abusefilter-warning-editpage 2 abusefilter-warning-clear-text 2 abusefilter-warning-deltemplate 2 abusefilter-warning-新規利用者による小さすぎる記事の作成 2 abusefilter-warning-40 2 abusefilter-warning-schuttingtaal 2 abusefilter-warning-autobiography 1 abusefilter-warning-testing 1 abusefilter-warning-53 1 abusefilter-warning-badredirect 1 abusefilter-warning-kwebbelen 1 abusefilter-warning-Wikificazione 1 abusefilter-warning-blankpage 1 abusefilter-warning-removing-templates-on-image-description 1 abusefilter-warning-titel 1 abusefilter-warning-9 1 abusefilter-warning-redirect 1 abusefilter-warning-short-article 1 abusefilter-warning-41 1 abusefilter-warning-38 1 abusefilter-blocked-display 1 abusefilter-warning-plain-text 1 abusefilter-warning-blankowanie-stron 1 abusefilter-warning-obrázek 1 abusefilter-warning-kapottelink 1 abusefilter-warning-他利用者ページの編集 1 abusefilter-warning-afbeelding 1 abusefilter-warning-zmizení 1 abusefilter-warning-43 1 abusefilter-warning-galleries-without-images 1
== Other errors == unsupported-captcha 1395 blocked 1379 editconflict 725 HTTP error 157 protectedpage 136 rvnosuchsection 114 badtoken 112 unknownerror 51 Anonymous token. 50 unknown 48 pagedeleted 25 hookaborted 15 emptypage 13 autoblocked 12 cascadeprotected 10 ratelimited 4 readonly 1
Those look like mostly warnings, which *shouldn't* be preventing editing but should just be showing a prompt before you can save. Is this not yet supported by the mobile editor?
-- brion
On Mon, Aug 19, 2013 at 12:08 PM, Jon Robson jdlrobson@gmail.com wrote:
Between 31st July 2013 (00:00:00) and August 19th (@ 18:53:18)...
15089 of all mobile edits resulted in an error compared to 23455 successful edits (38544 edits in total)- that's a 39% error rate which is simply unacceptable. The breakdown of these errors is as follows. The most alarming is AbuseFilter - it is accounting for 72% of all editing errors, costing all of our projects a lot of edits.
This is simply unacceptable and I'm not sure how we go about addressing this problem. I struggle to believe that 28% of all edits on mobile by registered users are abuse...
==AbuseFilter (10842, 72% of all errors)== abusefilter-warning-removal 4332 abusefilter-disallowed 2939 abusefilter-warning-13 723 abusefilter-warning-all-categories-removed 668 abusefilter-warning-ref-group-blanking 504 abusefilter-warning 388 abusefilter-warning-blanking 323 abusefilter-warning-rimozione-categorie 277 abusefilter-warning-removal-of-categories 182 abusefilter-warning-leeghalen 57 abusefilter-warning-uncat 55 abusefilter-warning-kategorilerinçıkarılması 43 abusefilter-warning-removing-information-template 41 abusefilter-warning-no-lead-section 35 abusefilter-warning-usuwanie-tekstu 34 Misbruikfilter-waarschuwing-categorie 29 abusefilter-warning-usuwanie-kategorii 17 abusefilter-warning-repeated-characters 17 abusefilter-warning-removal-cat 16 abusefilter-warning-kategorie 13 abusefilter-warning-17 12 abusefilter-blanking 10 abusefilter-warning-AFC 10 abusefilter-warning-vyprázdnění 8 abusefilter-warning-lowercase-letters 8 abusefilter-warning-shouting 6 abusefilter-warning-removal-of-templates 6 abusefilter-warning-email 6 abusefilter-blank 5 abusefilter-warning-large-nonenglish-addition 4 abusefilter-warning-short-new-article 4 abusefilter-warning-veryshortarticle 4 abusefilter-warning-nowiki 3 abusefilter-warning-používaná 3 abusefilter-warning-special-templates-removal 3 abusefilter-warning-largeaddition-notice 3 abusefilter-warning-nospaces 3 abusefilter-warning-talkblanking 3 abusefilter-warning-external-images 3 abusefilter-warning-8 3 abusefilter-warning-clear-page 2 abusefilter-warning-1 2 abusefilter-warning-badlang 2 abusefilter-warning-editpage 2 abusefilter-warning-clear-text 2 abusefilter-warning-deltemplate 2 abusefilter-warning-新規利用者による小さすぎる記事の作成 2 abusefilter-warning-40 2 abusefilter-warning-schuttingtaal 2 abusefilter-warning-autobiography 1 abusefilter-warning-testing 1 abusefilter-warning-53 1 abusefilter-warning-badredirect 1 abusefilter-warning-kwebbelen 1 abusefilter-warning-Wikificazione 1 abusefilter-warning-blankpage 1 abusefilter-warning-removing-templates-on-image-description 1 abusefilter-warning-titel 1 abusefilter-warning-9 1 abusefilter-warning-redirect 1 abusefilter-warning-short-article 1 abusefilter-warning-41 1 abusefilter-warning-38 1 abusefilter-blocked-display 1 abusefilter-warning-plain-text 1 abusefilter-warning-blankowanie-stron 1 abusefilter-warning-obrázek 1 abusefilter-warning-kapottelink 1 abusefilter-warning-他利用者ページの編集 1 abusefilter-warning-afbeelding 1 abusefilter-warning-zmizení 1 abusefilter-warning-43 1 abusefilter-warning-galleries-without-images 1
== Other errors == unsupported-captcha 1395 blocked 1379 editconflict 725 HTTP error 157 protectedpage 136 rvnosuchsection 114 badtoken 112 unknownerror 51 Anonymous token. 50 unknown 48 pagedeleted 25 hookaborted 15 emptypage 13 autoblocked 12 cascadeprotected 10 ratelimited 4 readonly 1
Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
On 19.08.2013, 23:08 Jon wrote:
This is simply unacceptable and I'm not sure how we go about addressing this problem. I struggle to believe that 28% of all edits on mobile by registered users are abuse...
Not necessarily abuse: the problems look like AF is preventing users from making mistakes. Or our editing inteface from screwing up users...
Most of the popular decline errors seem to be related to removal of large chunks of text, this sounds suspicious...
On Mon, Aug 19, 2013 at 3:14 PM, Max Semenik maxsem.wiki@gmail.com wrote:
Most of the popular decline errors seem to be related to removal of large chunks of text, this sounds suspicious...
Bug 52077, possibly?
I was actually bit by the abuse filter directly, as I was setting up a new page on Meta, using a newly created account:
1. Because the page included an external link, I needed to enter a CAPTCHA. 2. The AF then threw a warning that my changes appeared harmful, citing " new user youtube, &c" 3. I was then thrown back to the CAPTCHA, repeat endlessly. :) There was no way forward.
Thanks.
--Ken.
On Aug 19, 2013, at 3:24 PM, Brad Jorsch (Anomie) bjorsch@wikimedia.org wrote:
On Mon, Aug 19, 2013 at 3:14 PM, Max Semenik maxsem.wiki@gmail.com wrote:
Most of the popular decline errors seem to be related to removal of large chunks of text, this sounds suspicious...
Bug 52077, possibly?
-- Brad Jorsch (Anomie) Software Engineer Wikimedia Foundation _______________________________________________ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
On Mon, Aug 19, 2013 at 2:27 PM, Ken Snider ksnider@wikimedia.org wrote:
I was actually bit by the abuse filter directly, as I was setting up a new page on Meta, using a newly created account:
- Because the page included an external link, I needed to enter a CAPTCHA.
- The AF then threw a warning that my changes appeared harmful, citing "
new user youtube, &c" 3. I was then thrown back to the CAPTCHA, repeat endlessly. :) There was no way forward.
That in particular is a long-standing issue ( https://bugzilla.wikimedia.org/show_bug.cgi?id=20661). I've been meaning to fix it when I get a spare moment.
The other warnings about blanking sound suspicious. I think we fixed a bug a few weeks back where blanking a section was triggering the blanking rule. I think that's been deployed.
Thanks.
--Ken.
On Aug 19, 2013, at 3:24 PM, Brad Jorsch (Anomie) bjorsch@wikimedia.org wrote:
On Mon, Aug 19, 2013 at 3:14 PM, Max Semenik maxsem.wiki@gmail.com
wrote:
Most of the popular decline errors seem to be related to removal of large chunks of text, this sounds suspicious...
Bug 52077, possibly?
-- Brad Jorsch (Anomie) Software Engineer Wikimedia Foundation _______________________________________________ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Jon Robson wrote:
Between 31st July 2013 (00:00:00) and August 19th (@ 18:53:18)...
15089 of all mobile edits resulted in an error compared to 23455 successful edits (38544 edits in total)- that's a 39% error rate which is simply unacceptable. The breakdown of these errors is as follows. The most alarming is AbuseFilter - it is accounting for 72% of all editing errors, costing all of our projects a lot of edits.
[stats]
These numbers don't mean a whole lot (to me, at least) without a comparison to stats for non-mobile edits. We knew when the AbuseFilter was introduced that it wasn't always going to be used to filter only abuse. People naturally use it for all kinds of crazy purposes these days. Without a bit more context, it's difficult to know what's actually a problem (in relative terms).
MZMcBride
MZ brings up a good point. Do we have any idea what the reject rate is for Abusefilter on desktop?
Also is there any way to view the edits that triggered AbuseFilter to get an idea bout what % of them were actually vandalism?
On Mon, Aug 19, 2013 at 6:25 PM, MZMcBride z@mzmcbride.com wrote:
Jon Robson wrote:
Between 31st July 2013 (00:00:00) and August 19th (@ 18:53:18)...
15089 of all mobile edits resulted in an error compared to 23455 successful edits (38544 edits in total)- that's a 39% error rate which is simply unacceptable. The breakdown of these errors is as follows. The most alarming is AbuseFilter - it is accounting for 72% of all editing errors, costing all of our projects a lot of edits.
[stats]
These numbers don't mean a whole lot (to me, at least) without a comparison to stats for non-mobile edits. We knew when the AbuseFilter was introduced that it wasn't always going to be used to filter only abuse. People naturally use it for all kinds of crazy purposes these days. Without a bit more context, it's difficult to know what's actually a problem (in relative terms).
MZMcBride
Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
If you can figure out what abuse rule was triggered, you can look at all the hits on Special:AbuseLog. For example 'abusefilter-warning-all-categories-removed 668' is probably rule 132, so you can see that at https://en.wikipedia.org/w/index.php?title=Special:AbuseLog&wpSearchFilt...
On Tue, Aug 20, 2013 at 10:39 AM, Jon Robson jdlrobson@gmail.com wrote:
MZ brings up a good point. Do we have any idea what the reject rate is for Abusefilter on desktop?
Also is there any way to view the edits that triggered AbuseFilter to get an idea bout what % of them were actually vandalism?
On Mon, Aug 19, 2013 at 6:25 PM, MZMcBride z@mzmcbride.com wrote:
Jon Robson wrote:
Between 31st July 2013 (00:00:00) and August 19th (@ 18:53:18)...
15089 of all mobile edits resulted in an error compared to 23455 successful edits (38544 edits in total)- that's a 39% error rate which is simply unacceptable. The breakdown of these errors is as follows. The most alarming is AbuseFilter - it is accounting for 72% of all editing errors, costing all of our projects a lot of edits.
[stats]
These numbers don't mean a whole lot (to me, at least) without a comparison to stats for non-mobile edits. We knew when the AbuseFilter
was
introduced that it wasn't always going to be used to filter only abuse. People naturally use it for all kinds of crazy purposes these days. Without a bit more context, it's difficult to know what's actually a problem (in relative terms).
MZMcBride
Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
-- Jon Robson http://jonrobson.me.uk @rakugojon
Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
wikitech-l@lists.wikimedia.org