December 2018 - Cloud-admin-feed - lists.wikimedia.org

** RECOVERY alert - cloudvirt1023/ensure kvm processes are running is OK **
by nagios＠icinga1001.wikimedia.org 10 Dec '18

10 Dec '18

Notification Type: RECOVERY Service: ensure kvm processes are running Host: cloudvirt1023 Address: 10.64.20.42 State: OK Date/Time: Mon Dec 10 21:00:05 UTC 2018 Notes URLs: Additional Info: PROCS OK: 95 processes with regex args qemu-system-x86_64

1 0

** PROBLEM alert - cloudvirt1023/ensure kvm processes are running is CRITICAL **
by nagios＠icinga1001.wikimedia.org 10 Dec '18

10 Dec '18

Notification Type: PROBLEM Service: ensure kvm processes are running Host: cloudvirt1023 Address: 10.64.20.42 State: CRITICAL Date/Time: Mon Dec 10 20:57:55 UTC 2018 Notes URLs: Additional Info: PROCS CRITICAL: 96 processes with regex args qemu-system-x86_64

1 0

** RECOVERY alert - labstore1007/High load average is OK **
by nagios＠icinga1001.wikimedia.org 05 Dec '18

05 Dec '18

Notification Type: RECOVERY Service: High load average Host: labstore1007 Address: 208.80.155.106 State: OK Date/Time: Wed Dec 5 07:02:29 UTC 2018 Notes URLs: https://grafana.wikimedia.org/dashboard/db/labs-monitoring Additional Info: OK: Less than 85.00% above the threshold [16.0]

1 0

** PROBLEM alert - labstore1007/High load average is CRITICAL **
by nagios＠icinga1001.wikimedia.org 05 Dec '18

05 Dec '18

Notification Type: PROBLEM Service: High load average Host: labstore1007 Address: 208.80.155.106 State: CRITICAL Date/Time: Wed Dec 5 06:43:11 UTC 2018 Notes URLs: https://grafana.wikimedia.org/dashboard/db/labs-monitoring Additional Info: CRITICAL: 100.00% of data above the critical threshold [24.0]

1 0

** RECOVERY alert - labstore1007/High load average is OK **
by nagios＠icinga1001.wikimedia.org 05 Dec '18

05 Dec '18

Notification Type: RECOVERY Service: High load average Host: labstore1007 Address: 208.80.155.106 State: OK Date/Time: Wed Dec 5 06:15:17 UTC 2018 Notes URLs: https://grafana.wikimedia.org/dashboard/db/labs-monitoring Additional Info: OK: Less than 85.00% above the threshold [16.0]

1 0

** PROBLEM alert - labstore1007/High load average is CRITICAL **
by nagios＠icinga1001.wikimedia.org 05 Dec '18

05 Dec '18

Notification Type: PROBLEM Service: High load average Host: labstore1007 Address: 208.80.155.106 State: CRITICAL Date/Time: Wed Dec 5 06:00:39 UTC 2018 Notes URLs: https://grafana.wikimedia.org/dashboard/db/labs-monitoring Additional Info: CRITICAL: 100.00% of data above the critical threshold [24.0]

1 0

** RECOVERY alert - checker.tools.wmflabs.org/toolschecker: All k8s worker nodes are healthy is OK **
by nagios＠icinga1001.wikimedia.org 04 Dec '18

04 Dec '18

Notification Type: RECOVERY Service: toolschecker: All k8s worker nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: OK Date/Time: Tue Dec 4 22:35:24 UTC 2018 Notes URLs: Additional Info: HTTP OK: HTTP/1.1 200 OK - 166 bytes in 0.201 second response time

1 0

** ACKNOWLEDGEMENT alert - checker.tools.wmflabs.org/toolschecker: All k8s worker nodes are healthy is CRITICAL **
by nagios＠icinga1001.wikimedia.org 04 Dec '18

04 Dec '18

Notification Type: ACKNOWLEDGEMENT Service: toolschecker: All k8s worker nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Tue Dec 4 20:36:07 UTC 2018 Notes URLs: Additional Info: HTTP CRITICAL: HTTP/1.1 503 SERVICE UNAVAILABLE - string OK not found on http://checker.tools.wmflabs.org:80/k8s/nodes/ready - 513 bytes in 0.034 second response time

1 0

** PROBLEM alert - checker.tools.wmflabs.org/toolschecker: All k8s worker nodes are healthy is CRITICAL **
by nagios＠icinga1001.wikimedia.org 04 Dec '18

04 Dec '18

Notification Type: PROBLEM Service: toolschecker: All k8s worker nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Tue Dec 4 20:25:38 UTC 2018 Notes URLs: Additional Info: HTTP CRITICAL: HTTP/1.1 503 SERVICE UNAVAILABLE - string OK not found on http://checker.tools.wmflabs.org:80/k8s/nodes/ready - 513 bytes in 0.031 second response time

1 0

** RECOVERY alert - labstore1007/High load average is OK **
by nagios＠icinga1001.wikimedia.org 04 Dec '18

04 Dec '18

Notification Type: RECOVERY Service: High load average Host: labstore1007 Address: 208.80.155.106 State: OK Date/Time: Tue Dec 4 05:20:18 UTC 2018 Notes URLs: https://grafana.wikimedia.org/dashboard/db/labs-monitoring Additional Info: OK: Less than 85.00% above the threshold [16.0]

1 0

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed December 2018