November 2021 - Cloud-admin-feed - lists.wikimedia.org

** RECOVERY alert - labstore1006/Persistent high iowait is OK **
by nagios＠alert1001.wikimedia.org 04 Nov '21

04 Nov '21

Notification Type: RECOVERY Service: Persistent high iowait Host: labstore1006 Address: 208.80.154.7 State: OK Date/Time: Thu Nov 4 03:52:59 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: (C)10 ge (W)5 ge 1.606

1 0

** PROBLEM alert - labstore1006/Persistent high iowait is CRITICAL **
by nagios＠alert1001.wikimedia.org 04 Nov '21

04 Nov '21

Notification Type: PROBLEM Service: Persistent high iowait Host: labstore1006 Address: 208.80.154.7 State: CRITICAL Date/Time: Thu Nov 4 03:48:53 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: 12.7 ge 10

1 0

** PROBLEM alert - labstore1006/Persistent high iowait is CRITICAL **
by nagios＠alert1001.wikimedia.org 04 Nov '21

04 Nov '21

Notification Type: PROBLEM Service: Persistent high iowait Host: labstore1006 Address: 208.80.154.7 State: CRITICAL Date/Time: Thu Nov 4 03:40:47 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: 10.58 ge 10

1 0

** RECOVERY alert - cloudcontrol1003/Check for VMs leaked by the nova-fullstack test is OK **
by nagios＠alert1001.wikimedia.org 02 Nov '21

02 Nov '21

Notification Type: RECOVERY Service: Check for VMs leaked by the nova-fullstack test Host: cloudcontrol1003 Address: 208.80.154.23 State: OK Date/Time: Tue Nov 2 13:54:19 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_f… Acknowledged by : Additional Info: 0 instances in the admin-monitoring project

1 0

** PROBLEM alert - cloudcontrol1003/Check for VMs leaked by the nova-fullstack test is CRITICAL **
by nagios＠alert1001.wikimedia.org 02 Nov '21

02 Nov '21

Notification Type: PROBLEM Service: Check for VMs leaked by the nova-fullstack test Host: cloudcontrol1003 Address: 208.80.154.23 State: CRITICAL Date/Time: Tue Nov 2 13:46:22 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_f… Acknowledged by : Additional Info: 10 instances in the admin-monitoring project

1 0

** RECOVERY alert - checker.tools.wmflabs.org/toolschecker: All k8s worker nodes are healthy is OK **
by nagios＠alert1001.wikimedia.org 02 Nov '21

02 Nov '21

Notification Type: RECOVERY Service: toolschecker: All k8s worker nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: OK Date/Time: Tue Nov 2 13:31:20 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 200 OK - 158 bytes in 0.116 second response time

1 0

** PROBLEM alert - cloudcontrol1003/Check for VMs leaked by the nova-fullstack test is CRITICAL **
by nagios＠alert1001.wikimedia.org 02 Nov '21

02 Nov '21

Notification Type: PROBLEM Service: Check for VMs leaked by the nova-fullstack test Host: cloudcontrol1003 Address: 208.80.154.23 State: CRITICAL Date/Time: Tue Nov 2 13:13:28 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Check_f… Acknowledged by : Additional Info: 10 instances in the admin-monitoring project

1 0

[FIRING:99] PuppetAgentFailure tools (node warn)
by root＠wmflabs.org 02 Nov '21

02 Nov '21

1 0

[FIRING:8] PuppetAgentFailure paws (node warn)
by root＠wmflabs.org 02 Nov '21

02 Nov '21

1 0

[FIRING:97] PuppetAgentFailure tools (node warn)
by root＠wmflabs.org 02 Nov '21

02 Nov '21

1 0

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed November 2021