Dear list admins.
I noticed today some Too Many Requests errors when accessing the admin interface of some lists.
Has a new rate limit been introduced recently?
Seems so since 5 weeks: https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/432168/
And a secret task; https://phabricator.wikimedia.org/T194032
Found on https://wikitech.wikimedia.org/wiki/Server_Admin_Log#2018-05-11
Raimond
Hello.
On Wed, Jun 13, 2018 at 08:24:15AM +0200, Raimond Spekking wrote:
Seems so since 5 weeks: https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/432168/
And a secret task; https://phabricator.wikimedia.org/T194032
Found on https://wikitech.wikimedia.org/wiki/Server_Admin_Log#2018-05-11
Good.
I cannot access the task. Can you please give me any hint whom to contact for a change?
Am 13.06.2018 um 08:28 schrieb Patrick Rother:
Hello.
On Wed, Jun 13, 2018 at 08:24:15AM +0200, Raimond Spekking wrote:
Seems so since 5 weeks: https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/432168/
And a secret task; https://phabricator.wikimedia.org/T194032
Found on https://wikitech.wikimedia.org/wiki/Server_Admin_Log#2018-05-11
Good.
I cannot access the task. Can you please give me any hint whom to contact for a change?
Me neither :-(
The patch was submitted byKeith Herron kherron@wikimedia.org https://gerrit.wikimedia.org/r/#/q/owner:kherron%2540wikimedia.org+status:merged
Raimond https://gerrit.wikimedia.org/r/#/q/owner:kherron%2540wikimedia.org+status:merged
On Wed, Jun 13, 2018 at 08:34:30AM +0200, Raimond Spekking wrote:
Am 13.06.2018 um 08:28 schrieb Patrick Rother:
Hello.
On Wed, Jun 13, 2018 at 08:24:15AM +0200, Raimond Spekking wrote:
Seems so since 5 weeks: https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/432168/
And a secret task; https://phabricator.wikimedia.org/T194032
Found on https://wikitech.wikimedia.org/wiki/Server_Admin_Log#2018-05-11
Good.
I cannot access the task. Can you please give me any hint whom to contact for a change?
Me neither :-(
The patch was submitted byKeith Herron kherron@wikimedia.org https://gerrit.wikimedia.org/r/#/q/owner:kherron%2540wikimedia.org+status:merged
Will contact him. Thank you.
That ticket (and that patch) appear to be about the flood of email subscriptions and rate limiting those subscriptions and nothing specifically targeting the admin interface. I'm not sure how it's causing the message (whether that's intentional, a side effect of the subscription limit or something entirely different).
*James Alexander* Manager, Trust & Safety Wikimedia Foundation
On Tue, Jun 12, 2018 at 11:47 PM Patrick Rother krd@gulu.net wrote:
On Wed, Jun 13, 2018 at 08:34:30AM +0200, Raimond Spekking wrote:
Am 13.06.2018 um 08:28 schrieb Patrick Rother:
Hello.
On Wed, Jun 13, 2018 at 08:24:15AM +0200, Raimond Spekking wrote:
Seems so since 5 weeks: https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/432168/
And a secret task; https://phabricator.wikimedia.org/T194032
Found on
https://wikitech.wikimedia.org/wiki/Server_Admin_Log#2018-05-11
Good.
I cannot access the task. Can you please give me any hint whom to contact for a change?
Me neither :-(
The patch was submitted byKeith Herron kherron@wikimedia.org <
https://gerrit.wikimedia.org/r/#/q/owner:kherron%2540wikimedia.org+status:me...
Will contact him. Thank you. _______________________________________________ Listadmins mailing list Listadmins@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/listadmins
On Wed, Jun 13, 2018 at 8:56 AM James Alexander jalexander@wikimedia.org wrote:
That ticket (and that patch) appear to be about the flood of email subscriptions and rate limiting those subscriptions and nothing specifically targeting the admin interface. I'm not sure how it's causing the message (whether that's intentional, a side effect of the subscription limit or something entirely different).
As a sidenote: this activity has been going on for a while, we have detected in our systems as well, seems someone found a new way to abuse her botnet. I cannot quite see any purpose for it, apart from vandalism.
g
Hello,
Indeed, several weeks back subscription rate limiting was implemented to counter a flood of false list subscriptions.
Yesterday a new flood began, this time with requests for listinfo pages. This caused load to spike on the lists server leading to request timeouts from the web interface. Rate limiting of the listinfo interface was implemented as a stopgap measure to address this. More details are available in the task https://phabricator.wikimedia.org/T196989 https://phabricator.wikimedia.org/T196989
There is still work ongoing for a longer term solution. The current thinking is to explore caching of listinfo pages, making these requests much less expensive in terms of server resources, and reducing the dependency on rate limiting for protection.
Best, —Keith
On Jun 13, 2018, at 2:56 AM, James Alexander <jalexander@wikimedia.org mailto:jalexander@wikimedia.org> wrote:
That ticket (and that patch) appear to be about the flood of email subscriptions and rate limiting those subscriptions and nothing specifically targeting the admin interface. I'm not sure how it's causing the message (whether that's intentional, a side effect of the subscription limit or something entirely different).
James Alexander Manager, Trust & Safety Wikimedia Foundation
On Tue, Jun 12, 2018 at 11:47 PM Patrick Rother <krd@gulu.net mailto:krd@gulu.net> wrote: On Wed, Jun 13, 2018 at 08:34:30AM +0200, Raimond Spekking wrote:
Am 13.06.2018 um 08:28 schrieb Patrick Rother:
Hello.
On Wed, Jun 13, 2018 at 08:24:15AM +0200, Raimond Spekking wrote:
Seems so since 5 weeks: https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/432168/ https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/432168/
And a secret task; https://phabricator.wikimedia.org/T194032 https://phabricator.wikimedia.org/T194032
Found on https://wikitech.wikimedia.org/wiki/Server_Admin_Log#2018-05-11 https://wikitech.wikimedia.org/wiki/Server_Admin_Log#2018-05-11
Good.
I cannot access the task. Can you please give me any hint whom to contact for a change?
Me neither :-(
The patch was submitted byKeith Herron <kherron@wikimedia.org mailto:kherron@wikimedia.org> <https://gerrit.wikimedia.org/r/#/q/owner:kherron%2540wikimedia.org+status:me... https://gerrit.wikimedia.org/r/#/q/owner:kherron%2540wikimedia.org+status:merged>
Will contact him. Thank you. _______________________________________________ Listadmins mailing list Listadmins@lists.wikimedia.org mailto:Listadmins@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/listadmins https://lists.wikimedia.org/mailman/listinfo/listadmins _______________________________________________ Listadmins mailing list Listadmins@lists.wikimedia.org mailto:Listadmins@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/listadmins
listadmins@lists.wikimedia.org