October 2018 - Cloud-admin-feed - lists.wikimedia.org

** RECOVERY alert - cloudvirt1022/DPKG is OK **
by icinga＠einsteinium.wikimedia.org 22 Oct '18

22 Oct '18

Notification Type: RECOVERY Service: DPKG Host: cloudvirt1022 Address: 10.64.20.41 State: OK Date/Time: Mon Oct 22 21:28:27 UTC 2018 Notes URLs: Additional Info: All packages OK

1 0

** PROBLEM alert - cloudvirt1022/DPKG is CRITICAL **
by icinga＠einsteinium.wikimedia.org 22 Oct '18

22 Oct '18

Notification Type: PROBLEM Service: DPKG Host: cloudvirt1022 Address: 10.64.20.41 State: CRITICAL Date/Time: Mon Oct 22 21:21:46 UTC 2018 Notes URLs: Additional Info: DPKG CRITICAL dpkg reports broken packages

1 0

** RECOVERY alert - labstore1006/High load average is OK **
by icinga＠einsteinium.wikimedia.org 19 Oct '18

19 Oct '18

Notification Type: RECOVERY Service: High load average Host: labstore1006 Address: 208.80.154.7 State: OK Date/Time: Fri Oct 19 16:55:24 UTC 2018 Notes URLs: https://grafana.wikimedia.org/dashboard/db/labs-monitoring Additional Info: OK: Less than 85.00% above the threshold [16.0]

1 0

** PROBLEM alert - labstore1006/High load average is CRITICAL **
by icinga＠einsteinium.wikimedia.org 19 Oct '18

19 Oct '18

Notification Type: PROBLEM Service: High load average Host: labstore1006 Address: 208.80.154.7 State: CRITICAL Date/Time: Fri Oct 19 16:29:54 UTC 2018 Notes URLs: https://grafana.wikimedia.org/dashboard/db/labs-monitoring Additional Info: CRITICAL: 100.00% of data above the critical threshold [24.0]

1 0

** RECOVERY alert - labvirt1010/puppet last run is OK **
by icinga＠einsteinium.wikimedia.org 19 Oct '18

19 Oct '18

Notification Type: RECOVERY Service: puppet last run Host: labvirt1010 Address: 10.64.20.26 State: OK Date/Time: Fri Oct 19 06:59:43 UTC 2018 Notes URLs: Additional Info: OK: Puppet is currently enabled, last run 4 minutes ago with 0 failures

1 0

** PROBLEM alert - labvirt1010/puppet last run is CRITICAL **
by icinga＠einsteinium.wikimedia.org 19 Oct '18

19 Oct '18

Notification Type: PROBLEM Service: puppet last run Host: labvirt1010 Address: 10.64.20.26 State: CRITICAL Date/Time: Fri Oct 19 06:29:04 UTC 2018 Notes URLs: Additional Info: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apparmor.d/abstractions/ssl_certs]

1 0

** RECOVERY alert - checker.tools.wmflabs.org/toolschecker: All k8s worker nodes are healthy is OK **
by icinga＠einsteinium.wikimedia.org 19 Oct '18

19 Oct '18

Notification Type: RECOVERY Service: toolschecker: All k8s worker nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: OK Date/Time: Fri Oct 19 04:37:58 UTC 2018 Notes URLs: Additional Info: HTTP OK: HTTP/1.1 200 OK - 166 bytes in 0.163 second response time

1 0

** ACKNOWLEDGEMENT alert - checker.tools.wmflabs.org/toolschecker: All k8s worker nodes are healthy is CRITICAL **
by icinga＠einsteinium.wikimedia.org 19 Oct '18

19 Oct '18

Notification Type: ACKNOWLEDGEMENT Service: toolschecker: All k8s worker nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Fri Oct 19 03:59:39 UTC 2018 Notes URLs: Additional Info: HTTP CRITICAL: HTTP/1.1 503 SERVICE UNAVAILABLE - string OK not found on http://checker.tools.wmflabs.org:80/k8s/nodes/ready - 185 bytes in 0.200 second response time

1 0

** PROBLEM alert - checker.tools.wmflabs.org/toolschecker: All k8s worker nodes are healthy is CRITICAL **
by icinga＠einsteinium.wikimedia.org 19 Oct '18

19 Oct '18

Notification Type: PROBLEM Service: toolschecker: All k8s worker nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Fri Oct 19 03:57:07 UTC 2018 Notes URLs: Additional Info: HTTP CRITICAL: HTTP/1.1 503 SERVICE UNAVAILABLE - string OK not found on http://checker.tools.wmflabs.org:80/k8s/nodes/ready - 185 bytes in 0.200 second response time

1 0

** ACKNOWLEDGEMENT alert - cloudvirt1019/HP RAID is CRITICAL **
by icinga＠einsteinium.wikimedia.org 18 Oct '18

18 Oct '18

Notification Type: ACKNOWLEDGEMENT Service: HP RAID Host: cloudvirt1019 Address: 10.64.20.38 State: CRITICAL Date/Time: Thu Oct 18 16:37:28 UTC 2018 Notes URLs: Additional Info: CRITICAL: Slot 1: Failed: 1I:1:5, 1I:1:6, 1I:1:7, 1I:1:8 - OK: 2I:1:1, 2I:1:2, 2I:1:3, 2I:1:4, 2I:2:1, 2I:2:2 - Controller: OK - Battery/Capacitor: Recharging

1 0

2025

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed October 2018