Notification Type: PROBLEM
Service: Check systemd state
Host: cloudservices1003
Address: 208.80.154.135
State: CRITICAL
Date/Time: Mon Feb 21 20:37:35 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
Acknowledged by :
Additional Info:
CRITICAL - degraded: The following units failed: labs-ip-alias-dump.service
Notification Type: RECOVERY
Service: Check unit status of labs-ip-alias-dump
Host: cloudservices1004
Address: 208.80.154.11
State: OK
Date/Time: Mon Feb 21 20:32:57 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_time…
Acknowledged by :
Additional Info:
OK: Status of the systemd unit labs-ip-alias-dump
Notification Type: RECOVERY
Service: Check systemd state
Host: cloudservices1003
Address: 208.80.154.135
State: OK
Date/Time: Mon Feb 21 20:30:40 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
Acknowledged by :
Additional Info:
OK - running: The system is fully operational
Notification Type: RECOVERY
Service: Check systemd state
Host: cloudservices1004
Address: 208.80.154.11
State: OK
Date/Time: Mon Feb 21 20:30:39 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
Acknowledged by :
Additional Info:
OK - running: The system is fully operational
Notification Type: ACKNOWLEDGEMENT
Service: Check unit status of backup_cinder_volumes
Host: cloudcontrol1005
Address: 208.80.154.85
State: CRITICAL
Date/Time: Mon Feb 21 20:17:09 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_time…
Acknowledged by andrew bogott: probably more fallout from cloudcontrol1003
Additional Info:
CRITICAL: Status of the systemd unit backup_cinder_volumes
Notification Type: PROBLEM
Service: Check unit status of backup_cinder_volumes
Host: cloudcontrol1005
Address: 208.80.154.85
State: CRITICAL
Date/Time: Mon Feb 21 20:15:45 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_time…
Acknowledged by :
Additional Info:
CRITICAL: Status of the systemd unit backup_cinder_volumes
Notification Type: ACKNOWLEDGEMENT
Service: Check unit status of labs-ip-alias-dump
Host: cloudservices1003
Address: 208.80.154.135
State: CRITICAL
Date/Time: Mon Feb 21 19:39:04 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_time…
Acknowledged by andrew bogott: rebuilding cloudcontrol1003
Additional Info:
CRITICAL: Status of the systemd unit labs-ip-alias-dump
Notification Type: ACKNOWLEDGEMENT
Service: Check unit status of labs-ip-alias-dump
Host: cloudservices1004
Address: 208.80.154.11
State: CRITICAL
Date/Time: Mon Feb 21 19:37:33 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_time…
Acknowledged by andrew bogott: this is from me reimaging cloudcontrol1003
Additional Info:
CRITICAL: Status of the systemd unit labs-ip-alias-dump
Notification Type: ACKNOWLEDGEMENT
Service: Check systemd state
Host: cloudservices1004
Address: 208.80.154.11
State: CRITICAL
Date/Time: Mon Feb 21 19:37:33 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
Acknowledged by andrew bogott: this is from me reimaging cloudcontrol1003
Additional Info:
CRITICAL - degraded: The following units failed: labs-ip-alias-dump.service
Notification Type: ACKNOWLEDGEMENT
Service: Check systemd state
Host: cloudservices1003
Address: 208.80.154.135
State: CRITICAL
Date/Time: Mon Feb 21 19:37:33 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
Acknowledged by andrew bogott: this is from me reimaging cloudcontrol1003
Additional Info:
CRITICAL - degraded: The following units failed: labs-ip-alias-dump.service