This maintenance is now complete, services should be back to normal.

On 3/27/23 9:15 AM, Andrew Bogott wrote:

Due to unavoidable network switch maintenance[0], some WMCS services will be offline briefly tomorrow. The downtime will last for 20-30 minutes and take place sometime between 14:00 and 16:00 UTC.

Here is what to expect during the downtime:


* Toolsdb will be unavailable and all queries will fail

* Some of the wiki replica databases may be unavailable

* Some DNS servers will be offline; some services may fail to resolve hosts, depending on their fallback logic


We anticipate a graceful recovery from this outage, but NFS is fickle so we may need to reboot some or all VMs after the outage.

Sorry in advance for any inconvenience or upset emails that result from this maintenance.


- Andrew + the WMCS team


[0] https://phabricator.wikimedia.org/T330165