Notification Type: PROBLEM
Service: haproxy service failover
Host: cloudcontrol1007
Address: 208.80.155.104
State: CRITICAL
Date/Time: Mon Nov 7 21:03:04 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy
Acknowledged by :
Additional Info:
CRITICAL check_failover servers up 37 down 1:
Notification Type: PROBLEM
Service: Check systemd state
Host: cloudservices1004
Address: 208.80.154.11
State: CRITICAL
Date/Time: Mon Nov 7 21:01:12 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
Acknowledged by :
Additional Info:
CRITICAL - degraded: The following units failed: ifup(a)eno1.service
Notification Type: RECOVERY
Service: haproxy service failover
Host: cloudcontrol1006
Address: 208.80.154.149
State: OK
Date/Time: Mon Nov 7 20:54:08 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy
Acknowledged by :
Additional Info:
OK check_failover servers up 38 down 0:
Notification Type: RECOVERY
Service: haproxy service failover
Host: cloudcontrol1005
Address: 208.80.154.85
State: OK
Date/Time: Mon Nov 7 20:53:58 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy
Acknowledged by :
Additional Info:
OK check_failover servers up 38 down 0:
Notification Type: PROBLEM
Service: haproxy service failover
Host: cloudcontrol1006
Address: 208.80.154.149
State: CRITICAL
Date/Time: Mon Nov 7 20:52:06 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy
Acknowledged by :
Additional Info:
CRITICAL check_failover servers up 37 down 1:
Notification Type: PROBLEM
Service: haproxy service failover
Host: cloudcontrol1005
Address: 208.80.154.85
State: CRITICAL
Date/Time: Mon Nov 7 20:51:58 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy
Acknowledged by :
Additional Info:
CRITICAL check_failover servers up 37 down 1:
Notification Type: RECOVERY
Service: Check unit status of wmcs_monitoring_graphite_rsync
Host: cloudmetrics1004
Address: 10.64.37.6
State: OK
Date/Time: Mon Nov 7 09:47:07 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_time…
Acknowledged by :
Additional Info:
OK: Status of the systemd unit wmcs_monitoring_graphite_rsync
Notification Type: RECOVERY
Service: Check systemd state
Host: cloudmetrics1004
Address: 10.64.37.6
State: OK
Date/Time: Mon Nov 7 09:43:59 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
Acknowledged by :
Additional Info:
OK - running: The system is fully operational
Notification Type: PROBLEM
Service: Check systemd state
Host: cloudmetrics1004
Address: 10.64.37.6
State: CRITICAL
Date/Time: Mon Nov 7 09:38:59 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
Acknowledged by :
Additional Info:
CRITICAL - degraded: The following units failed: wmcs_monitoring_graphite_rsync.service