February 2022 - Cloud-admin-feed - lists.wikimedia.org

[FIRING:2] PuppetAgentStaleLastRun quarry (node warn)
by root＠wmflabs.org 22 Feb '22

22 Feb '22

1 0

[FIRING:2] PuppetAgentStaleLastRun quarry (node warn)
by root＠wmflabs.org 22 Feb '22

22 Feb '22

1 0

** RECOVERY alert - cloudcontrol1005/Check unit status of backup_cinder_volumes is OK **
by nagios＠alert1001.wikimedia.org 22 Feb '22

22 Feb '22

Notification Type: RECOVERY Service: Check unit status of backup_cinder_volumes Host: cloudcontrol1005 Address: 208.80.154.85 State: OK Date/Time: Tue Feb 22 02:30:47 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_time… Acknowledged by : Additional Info: OK: Status of the systemd unit backup_cinder_volumes

1 0

[FIRING:2] PuppetAgentStaleLastRun quarry (node warn)
by root＠wmflabs.org 22 Feb '22

22 Feb '22

1 0

** RECOVERY alert - cloudservices1004/Check unit status of labs-ip-alias-dump is OK **
by nagios＠alert1001.wikimedia.org 22 Feb '22

22 Feb '22

Notification Type: RECOVERY Service: Check unit status of labs-ip-alias-dump Host: cloudservices1004 Address: 208.80.154.11 State: OK Date/Time: Mon Feb 21 22:40:21 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_time… Acknowledged by : Additional Info: OK: Status of the systemd unit labs-ip-alias-dump

1 0

** ACKNOWLEDGEMENT alert - cloudcontrol1005/Galera haproxy failover is CRITICAL **
by nagios＠alert1001.wikimedia.org 22 Feb '22

22 Feb '22

Notification Type: ACKNOWLEDGEMENT Service: Galera haproxy failover Host: cloudcontrol1005 Address: 208.80.154.85 State: CRITICAL Date/Time: Mon Feb 21 22:40:04 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy Acknowledged by andrew bogott: fallout from cloudcontrol1003 rebuild Additional Info: CRITICAL check_failover servers up 31 down 4:

1 0

** ACKNOWLEDGEMENT alert - cloudcontrol1005/Check unit status of backup_cinder_volumes is CRITICAL **
by nagios＠alert1001.wikimedia.org 22 Feb '22

22 Feb '22

Notification Type: ACKNOWLEDGEMENT Service: Check unit status of backup_cinder_volumes Host: cloudcontrol1005 Address: 208.80.154.85 State: CRITICAL Date/Time: Mon Feb 21 22:40:04 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_time… Acknowledged by andrew bogott: fallout from cloudcontrol1003 rebuild Additional Info: CRITICAL: Status of the systemd unit backup_cinder_volumes

1 0

** ACKNOWLEDGEMENT alert - cloudcontrol1004/Galera haproxy failover is CRITICAL **
by nagios＠alert1001.wikimedia.org 22 Feb '22

22 Feb '22

Notification Type: ACKNOWLEDGEMENT Service: Galera haproxy failover Host: cloudcontrol1004 Address: 208.80.154.132 State: CRITICAL Date/Time: Mon Feb 21 22:40:04 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy Acknowledged by andrew bogott: fallout from cloudcontrol1003 rebuild Additional Info: CRITICAL check_failover servers up 31 down 4:

1 0

** ACKNOWLEDGEMENT alert - cloudcontrol1003/Galera haproxy failover is CRITICAL **
by nagios＠alert1001.wikimedia.org 22 Feb '22

22 Feb '22

Notification Type: ACKNOWLEDGEMENT Service: Galera haproxy failover Host: cloudcontrol1003 Address: 208.80.154.23 State: CRITICAL Date/Time: Mon Feb 21 22:40:04 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy Acknowledged by andrew bogott: fallout from cloudcontrol1003 rebuild Additional Info: CRITICAL check_failover servers up 29 down 3:

1 0

[FIRING:1] PuppetAgentStaleLastRun quarry (quarry-nfs-1 node warn)
by root＠wmflabs.org 22 Feb '22

22 Feb '22

1 0

2025

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed February 2022