Hi!
There will be a small network interruption next Monday at around 13:00 UTC as we will be doing some cleanup on the Openstack after network re-architecture (see https://phabricator.wikimedia.org/T348140).
It will affect all the CloudVPS and other services hosted there (including toolforge, PAWS, quarry and superset). VMs traffic to the internet will be cut for a short period, hopefully for a few seconds, while internal traffic will not be affected, but if you have any open ssh session to your VMs or login.toolforge.org, it might timeout or get dropped, and any web access to projects will not work during the downtime.
We will update on this email thread when we start and when we have finished.
This will help stabilize the network and avoid bigger outages in the future, so thanks for your patience!
Hi all!
As scheduled, this maintenance will be starting, I'll update once we have finished.
Cheers!
On Tue, Oct 17, 2023 at 4:53 PM David Caro dcaro@wikimedia.org wrote:
Hi!
There will be a small network interruption next Monday at around 13:00 UTC as we will be doing some cleanup on the Openstack after network re-architecture (see https://phabricator.wikimedia.org/T348140).
It will affect all the CloudVPS and other services hosted there (including toolforge, PAWS, quarry and superset). VMs traffic to the internet will be cut for a short period, hopefully for a few seconds, while internal traffic will not be affected, but if you have any open ssh session to your VMs or login.toolforge.org, it might timeout or get dropped, and any web access to projects will not work during the downtime.
We will update on this email thread when we start and when we have finished.
This will help stabilize the network and avoid bigger outages in the future, so thanks for your patience!
-- David Caro SRE - Cloud Services Wikimedia Foundation https://wikimediafoundation.org/ PGP Signature: 7180 83A2 AC8B 314F B4CE 1171 4071 C7E1 D262 69C3
"Imagine a world in which every single human being can freely share in the sum of all knowledge. That's our commitment."
_______________________________________________ Cloud-announce mailing list -- cloud-announce@lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.o...
Done!
Everything went as expected :), we had a small network downtime of ~45s, and no side-effects have been detected.
If you see anything suspicious please open a task and mention this one T348140 https://phabricator.wikimedia.org/T348140.
Cheers!
On Mon, Oct 23, 2023 at 3:00 PM David Caro dcaro@wikimedia.org wrote:
Hi all!
As scheduled, this maintenance will be starting, I'll update once we have finished.
Cheers!
On Tue, Oct 17, 2023 at 4:53 PM David Caro dcaro@wikimedia.org wrote:
Hi!
There will be a small network interruption next Monday at around 13:00 UTC as we will be doing some cleanup on the Openstack after network re-architecture (see https://phabricator.wikimedia.org/T348140).
It will affect all the CloudVPS and other services hosted there (including toolforge, PAWS, quarry and superset). VMs traffic to the internet will be cut for a short period, hopefully for a few seconds, while internal traffic will not be affected, but if you have any open ssh session to your VMs or login.toolforge.org, it might timeout or get dropped, and any web access to projects will not work during the downtime.
We will update on this email thread when we start and when we have finished.
This will help stabilize the network and avoid bigger outages in the future, so thanks for your patience!
-- David Caro SRE - Cloud Services Wikimedia Foundation https://wikimediafoundation.org/ PGP Signature: 7180 83A2 AC8B 314F B4CE 1171 4071 C7E1 D262 69C3
"Imagine a world in which every single human being can freely share in the sum of all knowledge. That's our commitment."
_______________________________________________ Cloud-announce mailing list -- cloud-announce@lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.o...