October 2018 - Cloud-admin-feed - lists.wikimedia.org

** RECOVERY alert - labmon1001/graphite-labs.wikimedia.org is OK **
by icinga＠einsteinium.wikimedia.org 12 Oct '18

12 Oct '18

Notification Type: RECOVERY Service: graphite-labs.wikimedia.org Host: labmon1001 Address: 10.64.37.13 State: OK Date/Time: Fri Oct 12 17:16:53 UTC 2018 Notes URLs: Additional Info: HTTP OK: HTTP/1.1 200 OK - 1590 bytes in 0.008 second response time

1 0

** PROBLEM alert - labmon1001/graphite-labs.wikimedia.org is CRITICAL **
by icinga＠einsteinium.wikimedia.org 12 Oct '18

12 Oct '18

Notification Type: PROBLEM Service: graphite-labs.wikimedia.org Host: labmon1001 Address: 10.64.37.13 State: CRITICAL Date/Time: Fri Oct 12 17:15:54 UTC 2018 Notes URLs: Additional Info: CRITICAL - Socket timeout after 10 seconds

1 0

** RECOVERY alert - labvirt1014/puppet last run is OK **
by icinga＠einsteinium.wikimedia.org 12 Oct '18

12 Oct '18

Notification Type: RECOVERY Service: puppet last run Host: labvirt1014 Address: 10.64.20.30 State: OK Date/Time: Fri Oct 12 06:57:57 UTC 2018 Notes URLs: Additional Info: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures

1 0

** PROBLEM alert - labvirt1014/puppet last run is CRITICAL **
by icinga＠einsteinium.wikimedia.org 12 Oct '18

12 Oct '18

Notification Type: PROBLEM Service: puppet last run Host: labvirt1014 Address: 10.64.20.30 State: CRITICAL Date/Time: Fri Oct 12 06:32:28 UTC 2018 Notes URLs: Additional Info: CRITICAL: Puppet has 1 failures. Last run 6 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apparmor.d/abstractions/ssl_certs]

1 0

** RECOVERY alert - cloudvirt1023/puppet last run is OK **
by icinga＠einsteinium.wikimedia.org 12 Oct '18

12 Oct '18

Notification Type: RECOVERY Service: puppet last run Host: cloudvirt1023 Address: 10.64.20.42 State: OK Date/Time: Fri Oct 12 02:46:48 UTC 2018 Notes URLs: Additional Info: OK: Puppet is currently enabled, last run 3 seconds ago with 0 failures

1 0

** PROBLEM alert - cloudvirt1023/puppet last run is CRITICAL **
by icinga＠einsteinium.wikimedia.org 12 Oct '18

12 Oct '18

Notification Type: PROBLEM Service: puppet last run Host: cloudvirt1023 Address: 10.64.20.42 State: CRITICAL Date/Time: Fri Oct 12 02:31:47 UTC 2018 Notes URLs: Additional Info: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues

1 0

** ACKNOWLEDGEMENT alert - cloudvirt1019/HP RAID is CRITICAL **
by icinga＠einsteinium.wikimedia.org 10 Oct '18

10 Oct '18

Notification Type: ACKNOWLEDGEMENT Service: HP RAID Host: cloudvirt1019 Address: 10.64.20.38 State: CRITICAL Date/Time: Wed Oct 10 16:07:55 UTC 2018 Notes URLs: Additional Info: CRITICAL: Slot 1: Failed: 1I:1:5, 1I:1:6, 1I:1:7, 1I:1:8 - OK: 2I:1:1, 2I:1:2, 2I:1:3, 2I:1:4, 2I:2:1, 2I:2:2 - Controller: OK - Battery count: 0

1 0

** RECOVERY alert - labvirt1004/puppet last run is OK **
by icinga＠einsteinium.wikimedia.org 09 Oct '18

09 Oct '18

Notification Type: RECOVERY Service: puppet last run Host: labvirt1004 Address: 10.64.20.22 State: OK Date/Time: Tue Oct 9 18:48:39 UTC 2018 Notes URLs: Additional Info: OK: Puppet is currently enabled, last run 4 minutes ago with 0 failures

1 0

** PROBLEM alert - labvirt1004/puppet last run is CRITICAL **
by icinga＠einsteinium.wikimedia.org 09 Oct '18

09 Oct '18

Notification Type: PROBLEM Service: puppet last run Host: labvirt1004 Address: 10.64.20.22 State: CRITICAL Date/Time: Tue Oct 9 18:18:19 UTC 2018 Notes URLs: Additional Info: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/usr/local/bin/apt2xml]

1 0

** RECOVERY alert - checker.tools.wmflabs.org/toolschecker: All k8s worker nodes are healthy is OK **
by icinga＠einsteinium.wikimedia.org 09 Oct '18

09 Oct '18

Notification Type: RECOVERY Service: toolschecker: All k8s worker nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: OK Date/Time: Tue Oct 9 08:23:20 UTC 2018 Notes URLs: Additional Info: HTTP OK: HTTP/1.1 200 OK - 166 bytes in 0.168 second response time

1 0

2025

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed October 2018