April 2022 - Cloud-admin-feed - lists.wikimedia.org

[FIRING:1] InstanceDown quarry (quarry-worker-04 node warn)
by root＠wmflabs.org 15 Apr '22

15 Apr '22

1 0

** RECOVERY alert - cloudcontrol1005/Check unit status of backup_cinder_volumes is OK **
by nagios＠alert1001.wikimedia.org 15 Apr '22

15 Apr '22

Notification Type: RECOVERY Service: Check unit status of backup_cinder_volumes Host: cloudcontrol1005 Address: 208.80.154.85 State: OK Date/Time: Fri Apr 15 10:32:42 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_u… Acknowledged by : Additional Info: OK: Status of the systemd unit backup_cinder_volumes

1 0

** RECOVERY alert - cloudvirt1021/Check unit status of backup_vms is OK **
by nagios＠alert1001.wikimedia.org 14 Apr '22

14 Apr '22

Notification Type: RECOVERY Service: Check unit status of backup_vms Host: cloudvirt1021 Address: 10.64.20.40 State: OK Date/Time: Thu Apr 14 20:04:41 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_u… Acknowledged by : Additional Info: OK: Status of the systemd unit backup_vms

1 0

** RECOVERY alert - cloudcontrol1004/Galera haproxy failover is OK **
by nagios＠alert1001.wikimedia.org 14 Apr '22

14 Apr '22

Notification Type: RECOVERY Service: Galera haproxy failover Host: cloudcontrol1004 Address: 208.80.154.132 State: OK Date/Time: Thu Apr 14 17:44:09 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy Acknowledged by : Additional Info: OK check_failover servers up 32 down 0:

1 0

** RECOVERY alert - cloudcontrol1004/cinder-api http is OK **
by nagios＠alert1001.wikimedia.org 14 Apr '22

14 Apr '22

Notification Type: RECOVERY Service: cinder-api http Host: cloudcontrol1004 Address: 208.80.154.132 State: OK Date/Time: Thu Apr 14 17:44:01 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 300 Multiple Choices - 904 bytes in 0.006 second response time

1 0

** RECOVERY alert - cloudcontrol1005/cinder-api http is OK **
by nagios＠alert1001.wikimedia.org 14 Apr '22

14 Apr '22

Notification Type: RECOVERY Service: cinder-api http Host: cloudcontrol1005 Address: 208.80.154.85 State: OK Date/Time: Thu Apr 14 17:43:43 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 300 Multiple Choices - 902 bytes in 0.006 second response time

1 0

** RECOVERY alert - cloudcontrol1003/Galera haproxy failover is OK **
by nagios＠alert1001.wikimedia.org 14 Apr '22

14 Apr '22

Notification Type: RECOVERY Service: Galera haproxy failover Host: cloudcontrol1003 Address: 208.80.154.23 State: OK Date/Time: Thu Apr 14 17:43:15 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy Acknowledged by : Additional Info: OK check_failover servers up 32 down 0:

1 0

** RECOVERY alert - cloudcontrol1005/Galera haproxy failover is OK **
by nagios＠alert1001.wikimedia.org 14 Apr '22

14 Apr '22

Notification Type: RECOVERY Service: Galera haproxy failover Host: cloudcontrol1005 Address: 208.80.154.85 State: OK Date/Time: Thu Apr 14 17:42:57 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy Acknowledged by : Additional Info: OK check_failover servers up 32 down 0:

1 0

** RECOVERY alert - cloudcontrol1003/cinder-api http is OK **
by nagios＠alert1001.wikimedia.org 14 Apr '22

14 Apr '22

Notification Type: RECOVERY Service: cinder-api http Host: cloudcontrol1003 Address: 208.80.154.23 State: OK Date/Time: Thu Apr 14 17:42:53 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 300 Multiple Choices - 902 bytes in 0.006 second response time

1 0

** PROBLEM alert - cloudcontrol1003/Galera haproxy failover is CRITICAL **
by nagios＠alert1001.wikimedia.org 14 Apr '22

14 Apr '22

Notification Type: PROBLEM Service: Galera haproxy failover Host: cloudcontrol1003 Address: 208.80.154.23 State: CRITICAL Date/Time: Thu Apr 14 17:32:11 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy Acknowledged by : Additional Info: CRITICAL check_failover servers up 29 down 4:

1 0

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed April 2022