Notification Type: ACKNOWLEDGEMENT
Service: Checks that the local airflow scheduler for airflow @search is working properly
Host: an-airflow1005
Address: 10.64.36.11
State: CRITICAL
Date/Time: Fri Mar 3 13:47:51 UTC 2023
Notes URLs: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Airflow
Acknowledged by Btullis: Host not yet in service: T327970
Additional Info:
CRITICAL: /usr/bin/env AIRFLOW_HOME=/srv/airflow-search /usr/lib/airflow/bin/airflow jobs check --job-type SchedulerJob --hostname an-airflow1005.eqiad.wmnet did not succeed
Notification Type: ACKNOWLEDGEMENT
Service: Checks that the airflow database for airflow search is working properly
Host: an-airflow1005
Address: 10.64.36.11
State: CRITICAL
Date/Time: Fri Mar 3 13:47:51 UTC 2023
Notes URLs: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Airflow
Acknowledged by Btullis: Host not yet in service: T327970
Additional Info:
CRITICAL: /usr/bin/env AIRFLOW_HOME=/srv/airflow-search /usr/lib/airflow/bin/airflow db check did not succeed
Notification Type: ACKNOWLEDGEMENT
Service: Check systemd state
Host: an-airflow1005
Address: 10.64.36.11
State: CRITICAL
Date/Time: Fri Mar 3 13:47:51 UTC 2023
Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
Acknowledged by Btullis: Host not yet in service: T327970
Additional Info:
CRITICAL - degraded: The following units failed: wmf_auto_restart_airflow-kerberos@search.service,wmf_auto_restart_airflow-webserver@search.service