May 2022 - Cloud-admin-feed - lists.wikimedia.org

** PROBLEM alert - cloudcontrol1003/Check for VMs leaked by the nova-fullstack test is CRITICAL **
by nagios＠alert1001.wikimedia.org 16 May '22

16 May '22

Notification Type: PROBLEM Service: Check for VMs leaked by the nova-fullstack test Host: cloudcontrol1003 Address: 208.80.154.23 State: CRITICAL Date/Time: Mon May 16 11:39:00 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_f… Acknowledged by : Additional Info: 10 instances in the admin-monitoring project

1 0

** PROBLEM alert - cloudcontrol1003/Check for VMs leaked by the nova-fullstack test is CRITICAL **
by nagios＠alert1001.wikimedia.org 16 May '22

16 May '22

Notification Type: PROBLEM Service: Check for VMs leaked by the nova-fullstack test Host: cloudcontrol1003 Address: 208.80.154.23 State: CRITICAL Date/Time: Mon May 16 11:25:28 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_f… Acknowledged by : Additional Info: 10 instances in the admin-monitoring project

1 0

** PROBLEM alert - cloudcontrol1003/Check for VMs leaked by the nova-fullstack test is CRITICAL **
by nagios＠alert1001.wikimedia.org 16 May '22

16 May '22

Notification Type: PROBLEM Service: Check for VMs leaked by the nova-fullstack test Host: cloudcontrol1003 Address: 208.80.154.23 State: CRITICAL Date/Time: Mon May 16 11:14:54 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_f… Acknowledged by : Additional Info: 10 instances in the admin-monitoring project

1 0

** PROBLEM alert - cloudcontrol1003/Check for VMs leaked by the nova-fullstack test is CRITICAL **
by nagios＠alert1001.wikimedia.org 16 May '22

16 May '22

Notification Type: PROBLEM Service: Check for VMs leaked by the nova-fullstack test Host: cloudcontrol1003 Address: 208.80.154.23 State: CRITICAL Date/Time: Mon May 16 11:01:40 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_f… Acknowledged by : Additional Info: 10 instances in the admin-monitoring project

1 0

** PROBLEM alert - cloudcontrol1003/Check for VMs leaked by the nova-fullstack test is CRITICAL **
by nagios＠alert1001.wikimedia.org 16 May '22

16 May '22

Notification Type: PROBLEM Service: Check for VMs leaked by the nova-fullstack test Host: cloudcontrol1003 Address: 208.80.154.23 State: CRITICAL Date/Time: Mon May 16 10:50:27 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_f… Acknowledged by : Additional Info: 10 instances in the admin-monitoring project

1 0

** PROBLEM alert - cloudcontrol1003/Check for VMs leaked by the nova-fullstack test is CRITICAL **
by nagios＠alert1001.wikimedia.org 16 May '22

16 May '22

Notification Type: PROBLEM Service: Check for VMs leaked by the nova-fullstack test Host: cloudcontrol1003 Address: 208.80.154.23 State: CRITICAL Date/Time: Mon May 16 10:13:36 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_f… Acknowledged by : Additional Info: 10 instances in the admin-monitoring project

1 0

[FIRING:1] InstanceDown tools (tools-sgeexec-0940 node warn)
by root＠wmflabs.org 16 May '22

16 May '22

1 0

** RECOVERY alert - labstore1006/Persistent high iowait is OK **
by nagios＠alert1001.wikimedia.org 16 May '22

16 May '22

Notification Type: RECOVERY Service: Persistent high iowait Host: labstore1006 Address: 208.80.154.7 State: OK Date/Time: Mon May 16 07:53:21 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/d/000000568/labstore1004-1005-1006-1007 Acknowledged by : Additional Info: (C)10 ge (W)5 ge 2.38

1 0

** PROBLEM alert - labstore1006/Persistent high iowait is CRITICAL **
by nagios＠alert1001.wikimedia.org 16 May '22

16 May '22

Notification Type: PROBLEM Service: Persistent high iowait Host: labstore1006 Address: 208.80.154.7 State: CRITICAL Date/Time: Mon May 16 07:03:43 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/d/000000568/labstore1004-1005-1006-1007 Acknowledged by : Additional Info: 66.85 ge 10

1 0

[FIRING:1] InstanceDown tools (tools-sgeexec-0940 node warn)
by root＠wmflabs.org 16 May '22

16 May '22

1 0

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed May 2022