Dear listadmins,
Please be aware of potential downtime on lists.wikimedia.org tomorrow
2022-01-13.
When: 09:00 UTC, for about 30 minutes (unlikely to take that long)
What: Incoming email may not be able to reach the lists.wikimedia.org
server and may need to be retried (usually automatic). Outgoing mail will
be delayed until the maintenance finishes.
Why: We need to apply a config change for the KVM settings for the VM
running lists.wikimedia.org which requires a reboot. It will be quite
brief, likely no more than five minutes, however if something goes wrong it
might take longer, hence the notification. More technical details are
available at https://phabricator.wikimedia.org/T294120.
Let us know if you have any questions. Please also forward/cross-post this
message as needed.
Thanks,
--
*Amir Sarabadani (he/him)*
Staff Database Architect
Wikimedia Foundation <https://wikimediafoundation.org/>
Dear listadmins,
Please be aware of potential downtime on lists.wikimedia.org next Tuesday,
2021-12-07.
When: 10:00 UTC, for about 30 minutes (unlikely to take that long)
What: Incoming email may not be able to reach the lists.wikimedia.org
server and may need to be retried (usually automatic). Outgoing mail will
be delayed until the maintenance finishes.
Why: We need to run some schema changes on the database of mailman to fix
bugs mentioned in the ticket. This can't be done unless we shut down
mailman software. It will be quite brief, likely no more than one minute,
however if something goes wrong it might take longer, hence the
notification. More technical details are available at
https://phabricator.wikimedia.org/T286552.
Let us know if you have any questions. Please also forward/cross-post this
message as needed.
Thanks,
--
*Amir Sarabadani (he/him)*
Staff Database Architect
Wikimedia Foundation <https://wikimediafoundation.org/>
Dear listadmins,
Please be aware for potential downtime on lists.wikimedia.org tomorrow,
2021-07-29.
When: 15:00 UTC, for about 30 minutes (unlikely to take that long)
What: Incoming email may not be able to reach the lists.wikimedia.org
server and may need to be retried (usually automatic). Outgoing mail
will be delayed until the maintenance finishes.
Why: The Network Operations team performing maintenance and will bring
all network traffic to lists.wikimedia.org to a complete stop. Most
likely this will take 1 second and no one will notice, however if
something goes wrong it will take down mailing lists, hence the
notification. More technical details are available at
<https://phabricator.wikimedia.org/T286032>.
Let us know if you have any questions. Please also forward/cross-post
this message as needed.
Thanks,
-- Kunal
Dear listadmins,
There will be some downtime on lists.wikimedia.org tomorrow, 2021-05-19.
When: 06:00 UTC, for about 30 minutes (unlikely to actually take that long).
What: Emails will be queued and not delivered until maintenance
finishes. The web interface will not work at this time.
Why: We need to apply some database schema changes to unblock migrating
the final lists: <https://phabricator.wikimedia.org/T282271>
If you want to follow along we'll be in #wikimedia-operations on IRC at
that time.
Let us know if you have any questions. Please also forward/cross-post
this message as needed.
Thanks,
-- Kunal
Hi,
The bounce processor in Mailman3 is much much better, in the past week
we've unsubscribed thousands of emails that have been bouncing for years.
However, the bounce processor crashes sometimes, so it builds up a queue
so you may receive floods of emails about users being unsubscribed.
We're working with the Mailman3 developers on this, it should be fixed
soon (I hope). <https://phabricator.wikimedia.org/T282348> tracks this.
Some lists also had really low bounce score thresholds, that likely
would have caused legitimate subscribers to be kicked off (the logs show
this only happened for the listadmins@ list, the irony). I went through
and increased the threshold on all lists (see [1] for affected lists) to
at least 5. If your list doesn't get enough activity to ever hit that
threshold, please increase the time the bounce info is valid for
("bounce info stale after") rather than reducing the threshold. I've
also documented this at [2].
[1] https://phabricator.wikimedia.org/T282501
[2]
https://meta.wikimedia.org/wiki/Mailing_lists/Administration#Bounce_process…
-- Kunal
Hello,
Two updates:
- We have been upgrading mailing lists to mailman3, now more than 1/4th of
mailing lists have been migrated, more follow today and next week. Some
actions needed (see below)
- We created a new mailing list called listadmins-announce and we are
turning listadmins to a discussion mailing list. So If you don't wish to be
involved in mailing list administration discussions, you can unsubscribe
from listadmins [1] [2]. But being a member of listadmins-announce is not
optional (you can unsubscribe, but you'll be automatically added back in
the next update).
*More on upgrade to mm3:*
Upgrading +700 mailing lists and more than 17 years of digital archive
is... challenging and Mailman3, while being much better than mailman2, is
not perfect.
One known issue is that the upgrade script sometimes truncates the info
field. We have made changes and reported it to upstream to mitigate it but
some mailing lists might not be easily fixable (python version
incompatibilities, etc.). So If your mailing list has been upgraded, please
check and fix that if it happens. Sorry for any inconvenience.
Private mailing lists won't be upgraded for now (possibly later next week
or the week after).
I recommend creating a central account [3] so you can have better control
over mailing lists you are a member of or you are an admin.
Please report any issues to us.
Happy emailing
[1]
https://lists.wikimedia.org/postorius/lists/listadmins.lists.wikimedia.org/
[2]
https://lists.wikimedia.org/postorius/lists/listadmins-announce.lists.wikim…
[3] https://lists.wikimedia.org/accounts/signup/
--
Amir (he/him)