Notification Type: RECOVERY
Service: Check unit status of backup_cinder_volumes
Host: cloudcontrol1005
Address: 208.80.154.85
State: OK
Date/Time: Wed Jun 29 10:33:11 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_u…
Acknowledged by :
Additional Info:
OK: Status of the systemd unit backup_cinder_volumes
Notification Type: PROBLEM
Service: Check unit status of backup_cinder_volumes
Host: cloudcontrol1005
Address: 208.80.154.85
State: CRITICAL
Date/Time: Wed Jun 29 07:13:20 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_u…
Acknowledged by :
Additional Info:
CRITICAL: Status of the systemd unit backup_cinder_volumes
Notification Type: RECOVERY
Service: nova-api http
Host: cloudcontrol1003
Address: 208.80.154.23
State: OK
Date/Time: Tue Jun 28 19:57:45 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting
Acknowledged by :
Additional Info:
HTTP OK: HTTP/1.1 200 OK - 445 bytes in 0.003 second response time
Notification Type: RECOVERY
Service: nova-api http
Host: cloudcontrol1005
Address: 208.80.154.85
State: OK
Date/Time: Tue Jun 28 19:52:49 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting
Acknowledged by :
Additional Info:
HTTP OK: HTTP/1.1 200 OK - 445 bytes in 0.003 second response time
Notification Type: RECOVERY
Service: nova-api http
Host: cloudcontrol1004
Address: 208.80.154.132
State: OK
Date/Time: Tue Jun 28 19:50:35 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting
Acknowledged by :
Additional Info:
HTTP OK: HTTP/1.1 200 OK - 447 bytes in 0.003 second response time
Notification Type: RECOVERY
Service: Galera haproxy failover
Host: cloudcontrol1003
Address: 208.80.154.23
State: OK
Date/Time: Tue Jun 28 19:49:21 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy
Acknowledged by :
Additional Info:
OK check_failover servers up 32 down 0:
Notification Type: RECOVERY
Service: Galera haproxy failover
Host: cloudcontrol1004
Address: 208.80.154.132
State: OK
Date/Time: Tue Jun 28 19:33:27 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy
Acknowledged by :
Additional Info:
OK check_failover servers up 32 down 0:
Notification Type: RECOVERY
Service: Ensure NFS exports are maintained for new instances with NFS
Host: labstore1004
Address: 10.64.37.19
State: OK
Date/Time: Tue Jun 28 19:28:07 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
Acknowledged by :
Additional Info:
OK - nfs-exportd is active
Notification Type: PROBLEM
Service: Ensure NFS exports are maintained for new instances with NFS
Host: labstore1004
Address: 10.64.37.19
State: CRITICAL
Date/Time: Tue Jun 28 19:25:55 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
Acknowledged by :
Additional Info:
CRITICAL - Expecting active but unit nfs-exportd is activating