This work is all complete now. Apologies for any inconvenience that it may have caused.

Please do let me know if you notice anything unusual about your Airflow pipelines that you feel may be related to this work.

Kind regards,
Ben

Hello all users of Airflow,

We need to perform some scheduled maintenance on all of our Airflow instances, so I'm scheduling a maintenance window for tomorrow at 08:30 UTC and I expect the work to take no more than 30 minutes. The work involves a reboot of the shared PostgreSQL database that serves all of our instances, as well as a reboot of some instances themselves.

I will pause all active DAGs on all Airflow instances prior to the work, allow some time for running tasks to complete, then un-pause the DAGs afterwards.
Naturally, you are also free to pause your own DAGs prior to the maintenance and un-pause them afterwards, should you wish to minimize the risk of disruption.

Please do let me know if there is anything specific that you would like me to check, either before or after this maintenance.

Kind regards,
Ben

--

Ben Tullis (he/him) Senior Site Reliability Engineer Wikimedia Foundation