Hello,
The Data Platform SRE team needs to carry out an upgrade of our *dse-k8s-eqiad* Kubernetes cluster, which will require some downtime for services hosted on this cluster.
If you don't use any of these services, you can ignore the rest of this message.
* Airflow * DataHub * GrowthBook * Flink * Spark History * Superset * Test Kitchen
These services will, unfortunately, require downtime while the Kubernetes upgrade is in progress.
The maintenance window, during which we will carry out the upgrade is this *Thursday March 26th, between 10:30 and 15:00 UTC*.
Some of our dse-k8s workload is already available in a multi-dc capacity on the *dse-k8s-codfw* cluster, so will *not* require downtime. Specifically, these are our OpenSearch on Kubernetes clusters for:
* opensearch-ipoid * opensearch-semantic-search
We will be keeping this ticket updated throughout the maintenance window, on our progress: T414484 Upgrade DSE clusters to kubernetes 1.31 https://phabricator.wikimedia.org/T414484
Once the Airflow services are running again, we will be working with representatives from the Data Engineering team to ensure that all data pipeline tasks have been addressed.
If you have any queries, comments, or concerns, please don't hesitate to share them with us. You can get in touch with us by reply to this message, or via #data-platform-sre on Slack, or #wikimedia-data-platform on IRC.
Kind regards, Ben
