Toolforge NFS services are not accessible to the VMs. Something went wrong during the upgrade and the team is working to restore services as quickly as possible.

I have shut off the bastions to protect their local disks.

Brooke Storm
Staff SRE
Wikimedia Cloud Services

On Apr 27, 2021, at 8:34 AM, Roy Smith <> wrote:

I'm getting timeouts and 502's on both and  Also:

ssh: connect to host port 22: Network is unreachable

Could the VPS work be causing this?

On Apr 27, 2021, at 10:03 AM, Andrew Bogott <> wrote:

Reminder: this is starting shortly.

On 4/27/21 12:48 AM, Andrew Bogott wrote:
We will be upgrading the Cloud-VPS OpenStack install later today beginning at 14:00 UTC (7:00 AM Pacific time).

The total upgrade should take 60-90 minutes.  During the upgrade period Horizon will be disabled.  There may also be brief network interruptions as we restart router services.

-Andrew + the WMCS Team

Wikimedia Cloud Services announce mailing list (formerly
Wikimedia Cloud Services mailing list (formerly

Wikimedia Cloud Services mailing list (formerly