Work on this is done. Thanks to this maintenance, NFS performance (especially read
performance) should be much improved. Failover will also now be quicker and more reliable
from now on. We appreciate your patience.
Brooke Storm
Staff SRE
Wikimedia Cloud Services
bstorm(a)wikimedia.org
On Dec 22, 2020, at 9:44 AM, Brooke Storm
<bstorm(a)wikimedia.org> wrote:
Unfortunately, the failover has not gone well due to some upgrades to the secondary it
seems. I apologize for the service disruptions, and we are trying to bring everything back
as fast as possible.
Brooke Storm
On Dec 22, 2020, at 8:56 AM, Brooke Storm
<bstorm(a)wikimedia.org> wrote:
We will be failing over the Toolforge and Project NFS in 10 minutes to move the main
interface to 10Gb Ethernet. The previous work should make this fairly non-disruptive, but
that was believed in the past as well.
Brooke Storm
Cloud Service Team