Notification Type: ACKNOWLEDGEMENT
Service: Check unit status of backup_cinder_volumes
Host: cloudcontrol1005
Address: 208.80.154.85
State: CRITICAL
Date/Time: Wed Aug 24 20:21:09 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_u…
Acknowledged by Andrew Bogott: this is a side-effect of cloudservices1005 being in progress
Additional Info:
CRITICAL: Status of the systemd unit backup_cinder_volumes
Notification Type: RECOVERY
Service: Galera haproxy failover
Host: cloudcontrol1005
Address: 208.80.154.85
State: OK
Date/Time: Wed Aug 24 20:11:54 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy
Acknowledged by :
Additional Info:
OK check_failover servers up 33 down 0:
Notification Type: RECOVERY
Service: Galera haproxy failover
Host: cloudcontrol1006
Address: 208.80.154.149
State: OK
Date/Time: Wed Aug 24 20:11:38 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy
Acknowledged by :
Additional Info:
OK check_failover servers up 33 down 0:
Notification Type: RECOVERY
Service: Galera haproxy failover
Host: cloudcontrol1007
Address: 208.80.155.104
State: OK
Date/Time: Wed Aug 24 20:11:36 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy
Acknowledged by :
Additional Info:
OK check_failover servers up 33 down 0:
Notification Type: RECOVERY
Service: Check for gridmaster host resolution UDP
Host: cloudservices1005
Address: 208.80.154.148
State: OK
Date/Time: Wed Aug 24 19:56:16 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting
Acknowledged by :
Additional Info:
DNS OK - 0.020 seconds response time (tools-sgegrid-master.tools.eqiad1.wikimedia.cloud. 60 IN A 172.16.5.129)
Notification Type: RECOVERY
Service: Check for gridmaster host resolution TCP
Host: cloudservices1005
Address: 208.80.154.148
State: OK
Date/Time: Wed Aug 24 19:33:18 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting
Acknowledged by :
Additional Info:
DNS OK - 0.017 seconds response time (tools-sgegrid-master.tools.eqiad1.wikimedia.cloud. 60 IN A 172.16.5.129)
Notification Type: RECOVERY
Service: Check unit status of labs-ip-alias-dump
Host: cloudservices1005
Address: 208.80.154.148
State: OK
Date/Time: Wed Aug 24 19:18:48 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_time…
Acknowledged by :
Additional Info:
OK: Status of the systemd unit labs-ip-alias-dump