February 2023 - Cloud-admin-feed - lists.wikimedia.org

[FIRING:2] ProbeDown tools (ip4 probes/custom http_this_tool_does_not_exist_toolforge_org_ip4 warning prometheus wmcs)
by root＠wmflabs.org 10 Feb '23

10 Feb '23

1 0

[RESOLVED] ProbeDown tools (ip4 probes/custom http_this_tool_does_not_exist_toolforge_org_ip4 warning prometheus wmcs)
by root＠wmflabs.org 10 Feb '23

10 Feb '23

1 0

[FIRING:1] ProbeDown tools (ip4 probes/custom http_this_tool_does_not_exist_toolforge_org_ip4 warning prometheus wmcs)
by root＠wmflabs.org 10 Feb '23

10 Feb '23

1 0

** RECOVERY alert - clouddumps1001/Persistent high iowait is OK **
by nagios＠alert1001.wikimedia.org 10 Feb '23

10 Feb '23

Notification Type: RECOVERY Service: Persistent high iowait Host: clouddumps1001 Address: 208.80.154.142 State: OK Date/Time: Fri Feb 10 19:39:37 UTC 2023 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/d/000000568/labstore1004-1005 Acknowledged by : Additional Info: (C)10 ge (W)5 ge 2.633

1 0

** PROBLEM alert - clouddumps1001/Persistent high iowait is CRITICAL **
by nagios＠alert1001.wikimedia.org 10 Feb '23

10 Feb '23

Notification Type: PROBLEM Service: Persistent high iowait Host: clouddumps1001 Address: 208.80.154.142 State: CRITICAL Date/Time: Fri Feb 10 19:34:15 UTC 2023 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/d/000000568/labstore1004-1005 Acknowledged by : Additional Info: 13.6 ge 10

1 0

** PROBLEM alert - clouddumps1001/Persistent high iowait is CRITICAL **
by nagios＠alert1001.wikimedia.org 10 Feb '23

10 Feb '23

Notification Type: PROBLEM Service: Persistent high iowait Host: clouddumps1001 Address: 208.80.154.142 State: CRITICAL Date/Time: Fri Feb 10 19:30:39 UTC 2023 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/d/000000568/labstore1004-1005 Acknowledged by : Additional Info: 13 ge 10

1 0

** RECOVERY alert - cloudbackup1004/Check unit status of backup_vms is OK **
by nagios＠alert1001.wikimedia.org 10 Feb '23

10 Feb '23

Notification Type: RECOVERY Service: Check unit status of backup_vms Host: cloudbackup1004 Address: 10.64.20.23 State: OK Date/Time: Fri Feb 10 17:01:25 UTC 2023 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_u… Acknowledged by : Additional Info: OK: Status of the systemd unit backup_vms

1 0

[RESOLVED] InstanceDown tools (tools-prometheus-6 node warn)
by root＠wmflabs.org 10 Feb '23

10 Feb '23

1 0

[FIRING:1] InstanceDown tools (tools-prometheus-6 node warn)
by root＠wmflabs.org 10 Feb '23

10 Feb '23

1 0

** RECOVERY alert - cloudcontrol1006/haproxy service failover is OK **
by nagios＠alert1001.wikimedia.org 10 Feb '23

10 Feb '23

Notification Type: RECOVERY Service: haproxy service failover Host: cloudcontrol1006 Address: 208.80.154.149 State: OK Date/Time: Fri Feb 10 01:59:13 UTC 2023 Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy Acknowledged by : Additional Info: OK check_failover servers up 38 down 0:

1 0

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed February 2023