Erik Moeller erik@wikimedia.org wrote:
We had a fibre cut of our connection to our Tampa DC this morning. ETA of a fix is still pending, but the cuts have been located and crews are being dispatched. Meanwhile public traffic is being rerouted via the public Internet, so most services should be reachable. Tampa is our secondary DC which we're decommissioning, so there was no impact on our main sites. Impacted temporarily were: inbound Wikimedia.org email, Bugzilla, Labs. Fundraising is still impacted, but shouldn't be (we're debugging).
Small correction: Labs is still impacted as neither the replica servers nor Wikipedia & Co. can be reached without the link so tools and bots relying on that are out of ser- vice at the moment.
Tim