Most of the outage is resolved already, we are finishing up recovering.
CloudVPS projects should be mostly functional:
* Most instances have network access at this point. The remaining VMs without network access are currently being fixed.
* Most NFS shared storage servers have been rebooted. It's possible some NFS clients have got stuck as a result, we're looking for those but if you have such a project and your client is stuck, rebooting should unblock it.
Toolforge is mostly functional:
*
NFS had a hiccup and we had to reboot all the worker nodes, the
kubernetes side should be fully functional but grid is still restarting
web services, we estimate this will take less than an hour from this point.
Paws should be fully functional.
Superset should be fully functional.
Will update as soon as everything is fixed (or in a few hours if there are still issues).
Thanks!