June 2022 - Cloud-admin-feed - lists.wikimedia.org

[FIRING:1] PuppetAgentNoResources tools (tools-sgeweblight-10-5 node warn)
by root＠wmflabs.org 03 Jun '22

03 Jun '22

1 0

[FIRING:1] InstanceDown tools (tools-sgeweblight-10-10 node warn)
by root＠wmflabs.org 03 Jun '22

03 Jun '22

1 0

[FIRING:1] PuppetAgentFailure tools (tools-sgeweblight-10-4 node warn)
by root＠wmflabs.org 03 Jun '22

03 Jun '22

1 0

** RECOVERY alert - cloudcontrol1003/Check for VMs leaked by the nova-fullstack test is OK **
by nagios＠alert1001.wikimedia.org 03 Jun '22

03 Jun '22

Notification Type: RECOVERY Service: Check for VMs leaked by the nova-fullstack test Host: cloudcontrol1003 Address: 208.80.154.23 State: OK Date/Time: Fri Jun 3 14:08:06 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_f… Acknowledged by : Additional Info: 2 instances in the admin-monitoring project

1 0

** PROBLEM alert - cloudcontrol1003/Check for VMs leaked by the nova-fullstack test is CRITICAL **
by nagios＠alert1001.wikimedia.org 03 Jun '22

03 Jun '22

Notification Type: PROBLEM Service: Check for VMs leaked by the nova-fullstack test Host: cloudcontrol1003 Address: 208.80.154.23 State: CRITICAL Date/Time: Fri Jun 3 14:03:30 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_f… Acknowledged by : Additional Info: 10 instances in the admin-monitoring project

1 0

** PROBLEM alert - cloudcontrol1003/Check for VMs leaked by the nova-fullstack test is CRITICAL **
by nagios＠alert1001.wikimedia.org 03 Jun '22

03 Jun '22

Notification Type: PROBLEM Service: Check for VMs leaked by the nova-fullstack test Host: cloudcontrol1003 Address: 208.80.154.23 State: CRITICAL Date/Time: Fri Jun 3 13:54:44 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_f… Acknowledged by : Additional Info: 10 instances in the admin-monitoring project

1 0

** PROBLEM alert - cloudcontrol1003/Check for VMs leaked by the nova-fullstack test is CRITICAL **
by nagios＠alert1001.wikimedia.org 03 Jun '22

03 Jun '22

Notification Type: PROBLEM Service: Check for VMs leaked by the nova-fullstack test Host: cloudcontrol1003 Address: 208.80.154.23 State: CRITICAL Date/Time: Fri Jun 3 13:45:52 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_f… Acknowledged by : Additional Info: 10 instances in the admin-monitoring project

1 0

[FIRING:1] ToolsGridQueueProblem tools (tools-sgeweblight-10-6.tools.eqiad1.wikimedia.cloud tools-sgegrid-master node webgrid-lighttpd warn dE)
by root＠wmflabs.org 03 Jun '22

03 Jun '22

1 0

** RECOVERY alert - cloudcontrol1005/tools project instance distribution is OK **
by nagios＠alert1001.wikimedia.org 03 Jun '22

03 Jun '22

Notification Type: RECOVERY Service: tools project instance distribution Host: cloudcontrol1005 Address: 208.80.154.85 State: OK Date/Time: Fri Jun 3 11:07:12 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting Acknowledged by : Additional Info: OK: All critical instances are spread out enough

1 0

** RECOVERY alert - cloudcontrol1003/tools project instance distribution is OK **
by nagios＠alert1001.wikimedia.org 03 Jun '22

03 Jun '22

Notification Type: RECOVERY Service: tools project instance distribution Host: cloudcontrol1003 Address: 208.80.154.23 State: OK Date/Time: Fri Jun 3 11:05:38 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting Acknowledged by : Additional Info: OK: All critical instances are spread out enough

1 0

2025

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed June 2022