Work on this is done. Thanks to this maintenance, NFS performance (especially read performance) should be much improved. Failover will also now be quicker and more reliable from now on. We appreciate your patience.

Brooke Storm Staff SRE Wikimedia Cloud Services bstorm@wikimedia.org

On Dec 22, 2020, at 9:44 AM, Brooke Storm bstorm@wikimedia.org wrote:

Unfortunately, the failover has not gone well due to some upgrades to the secondary it seems. I apologize for the service disruptions, and we are trying to bring everything back as fast as possible.

Brooke Storm

...

On Dec 22, 2020, at 8:56 AM, Brooke Storm bstorm@wikimedia.org wrote:

We will be failing over the Toolforge and Project NFS in 10 minutes to move the main interface to 10Gb Ethernet. The previous work should make this fairly non-disruptive, but that was believed in the past as well.

Brooke Storm Cloud Service Team

_______________________________________________ Wikimedia Cloud Services announce mailing list Cloud-announce@lists.wikimedia.org (formerly labs-announce@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud-announce