September 2022 - Cloud-admin-feed

** RECOVERY alert - cloudbackup2001/Check systemd state is OK **
by nagios＠alert1001.wikimedia.org 01 Oct '22

01 Oct '22

Notification Type: RECOVERY Service: Check systemd state Host: cloudbackup2001 Address: 10.192.0.130 State: OK Date/Time: Fri Sept 30 21:02:38 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state Acknowledged by : Additional Info: OK - running: The system is fully operational

1 0

[FIRING:2] InstanceDown tools (node warn)
by root＠wmflabs.org 30 Sep '22

30 Sep '22

1 0

[FIRING:1] InstanceDown tools (tools-sgeweblight-10-19 node warn)
by root＠wmflabs.org 30 Sep '22

30 Sep '22

1 0

** ACKNOWLEDGEMENT alert - cloudvirt1023/MegaRAID is CRITICAL **
by nagios＠alert1001.wikimedia.org 30 Sep '22

30 Sep '22

Notification Type: ACKNOWLEDGEMENT Service: MegaRAID Host: cloudvirt1023 Address: 10.64.20.42 State: CRITICAL Date/Time: Fri Sept 30 08:05:56 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/MegaCli%23Monitoring Acknowledged by nagiosadmin: RAID handler auto-ack: https://phabricator.wikimedia.org/T319001 Additional Info: CRITICAL: 1 failed LD(s) (Degraded)

1 0

** PROBLEM alert - cloudvirt1023/MegaRAID is CRITICAL **
by nagios＠alert1001.wikimedia.org 30 Sep '22

30 Sep '22

Notification Type: PROBLEM Service: MegaRAID Host: cloudvirt1023 Address: 10.64.20.42 State: CRITICAL Date/Time: Fri Sept 30 08:05:55 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/MegaCli%23Monitoring Acknowledged by : Additional Info: CRITICAL: 1 failed LD(s) (Degraded)

1 0

[FIRING:1] ProbeDown tools (172.16.4.136 ip4 tools-k8s-haproxy-4:30000 probes/custom http_admin_toolforge_org_ip4 warning prometheus wmcs)
by root＠wmflabs.org 30 Sep '22

30 Sep '22

1 0

[FIRING:2] ProbeDown tools (ip4 probes/custom http_admin_toolforge_org_ip4 warning prometheus wmcs)
by root＠wmflabs.org 30 Sep '22

30 Sep '22

1 0

[FIRING:1] ProbeDown tools (172.16.4.136 ip4 tools-k8s-haproxy-4:30000 probes/custom http_admin_toolforge_org_ip4 warning prometheus wmcs)
by root＠wmflabs.org 30 Sep '22

30 Sep '22

1 0

[FIRING:1] ProbeDown tools (172.16.4.136 ip4 tools-k8s-haproxy-4:30000 probes/custom http_admin_toolforge_org_ip4 warning prometheus wmcs)
by root＠wmflabs.org 30 Sep '22

30 Sep '22

1 0

[FIRING:1] ProbeDown tools (172.16.5.92 ip4 tools-k8s-haproxy-3:30000 probes/custom http_admin_toolforge_org_ip4 warning prometheus wmcs)
by root＠wmflabs.org 30 Sep '22

30 Sep '22

1 0

2025

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed September 2022