November 2022 - Cloud-admin-feed - lists.wikimedia.org

** RECOVERY alert - cloudvirt-wdqs1002/nova-compute proc minimum is OK **
by nagios＠alert1001.wikimedia.org 30 Nov '22

30 Nov '22

Notification Type: RECOVERY Service: nova-compute proc minimum Host: cloudvirt-wdqs1002 Address: 10.64.20.45 State: OK Date/Time: Wed Nov 30 20:29:21 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting Acknowledged by : Additional Info: PROCS OK: 1 process with regex args ^/usr/bin/pytho[n].* /usr/bin/nova-compute

1 0

** PROBLEM alert - checker.tools.wmflabs.org/toolschecker: All k8s worker nodes are healthy is CRITICAL **
by nagios＠alert1001.wikimedia.org 30 Nov '22

30 Nov '22

Notification Type: PROBLEM Service: toolschecker: All k8s worker nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Wed Nov 30 20:27:03 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP CRITICAL: HTTP/1.1 503 SERVICE UNAVAILABLE - string OK not found on http://checker.tools.wmflabs.org:80/k8s/nodes/ready - 177 bytes in 0.144 second response time

1 0

** RECOVERY alert - cloudvirt-wdqs1001/nova-compute proc minimum is OK **
by nagios＠alert1001.wikimedia.org 30 Nov '22

30 Nov '22

Notification Type: RECOVERY Service: nova-compute proc minimum Host: cloudvirt-wdqs1001 Address: 10.64.20.44 State: OK Date/Time: Wed Nov 30 20:24:35 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting Acknowledged by : Additional Info: PROCS OK: 1 process with regex args ^/usr/bin/pytho[n].* /usr/bin/nova-compute

1 0

** RECOVERY alert - cloudvirt-wdqs1001/nova-compute proc maximum is OK **
by nagios＠alert1001.wikimedia.org 30 Nov '22

30 Nov '22

Notification Type: RECOVERY Service: nova-compute proc maximum Host: cloudvirt-wdqs1001 Address: 10.64.20.44 State: OK Date/Time: Wed Nov 30 20:22:17 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting Acknowledged by : Additional Info: PROCS OK: 1 process with PPID = 1, regex args ^/usr/bin/pytho[n].* /usr/bin/nova-compute

1 0

** PROBLEM alert - cloudcontrol1006/haproxy service failover is CRITICAL **
by nagios＠alert1001.wikimedia.org 30 Nov '22

30 Nov '22

Notification Type: PROBLEM Service: haproxy service failover Host: cloudcontrol1006 Address: 208.80.154.149 State: CRITICAL Date/Time: Wed Nov 30 20:21:51 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy Acknowledged by : Additional Info: CRITICAL check_failover servers up 36 down 1:

1 0

** PROBLEM alert - cloudcontrol1005/haproxy service failover is CRITICAL **
by nagios＠alert1001.wikimedia.org 30 Nov '22

30 Nov '22

Notification Type: PROBLEM Service: haproxy service failover Host: cloudcontrol1005 Address: 208.80.154.85 State: CRITICAL Date/Time: Wed Nov 30 20:21:45 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy Acknowledged by : Additional Info: CRITICAL check_failover servers up 37 down 1:

1 0

** PROBLEM alert - cloudcontrol1007/haproxy service failover is CRITICAL **
by nagios＠alert1001.wikimedia.org 30 Nov '22

30 Nov '22

Notification Type: PROBLEM Service: haproxy service failover Host: cloudcontrol1007 Address: 208.80.155.104 State: CRITICAL Date/Time: Wed Nov 30 20:21:39 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy Acknowledged by : Additional Info: CRITICAL check_failover servers up 37 down 1:

1 0

[FIRING:1] InstanceDown tools (node warn)
by root＠wmflabs.org 30 Nov '22

30 Nov '22

1 0

** RECOVERY alert - cloudservices1005/designate-producer process is OK **
by nagios＠alert1001.wikimedia.org 30 Nov '22

30 Nov '22

Notification Type: RECOVERY Service: designate-producer process Host: cloudservices1005 Address: 208.80.154.148 State: OK Date/Time: Wed Nov 30 20:17:35 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting Acknowledged by : Additional Info: PROCS OK: 1 process with regex args ^/usr/bin/python.* /usr/bin/designate-producer

1 0

** RECOVERY alert - cloudservices1004/designate-central process is OK **
by nagios＠alert1001.wikimedia.org 30 Nov '22

30 Nov '22

Notification Type: RECOVERY Service: designate-central process Host: cloudservices1004 Address: 208.80.154.11 State: OK Date/Time: Wed Nov 30 20:17:29 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting Acknowledged by : Additional Info: PROCS OK: 1 process with regex args ^/usr/bin/python.* /usr/bin/designate-central

1 0

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed November 2022