January 2019 - Cloud-admin-feed - lists.wikimedia.org

** ACKNOWLEDGEMENT alert - checker.tools.wmflabs.org/toolschecker: NFS read/writeable on labs instances is CRITICAL **
by nagios＠icinga1001.wikimedia.org 10 Jan '19

10 Jan '19

Notification Type: ACKNOWLEDGEMENT Service: toolschecker: NFS read/writeable on labs instances Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Thu Jan 10 10:38:09 UTC 2019 Notes URLs: Additional Info: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string OK not found on http://checker.tools.wmflabs.org:80/nfs/home - 341 bytes in 0.005 second response time

1 0

** ACKNOWLEDGEMENT alert - checker.tools.wmflabs.org/toolschecker: All k8s worker nodes are healthy is CRITICAL **
by nagios＠icinga1001.wikimedia.org 10 Jan '19

10 Jan '19

Notification Type: ACKNOWLEDGEMENT Service: toolschecker: All k8s worker nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Thu Jan 10 10:38:09 UTC 2019 Notes URLs: Additional Info: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string OK not found on http://checker.tools.wmflabs.org:80/k8s/nodes/ready - 341 bytes in 0.003 second response time

1 0

** ACKNOWLEDGEMENT alert - checker.tools.wmflabs.org/toolschecker: All k8s etcd nodes are healthy is CRITICAL **
by nagios＠icinga1001.wikimedia.org 10 Jan '19

10 Jan '19

Notification Type: ACKNOWLEDGEMENT Service: toolschecker: All k8s etcd nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Thu Jan 10 10:38:08 UTC 2019 Notes URLs: Additional Info: connect to address checker.tools.wmflabs.org and port 80: Connection refused

1 0

** ACKNOWLEDGEMENT alert - checker.tools.wmflabs.org/toolschecker: All Flannel etcd nodes are healthy is CRITICAL **
by nagios＠icinga1001.wikimedia.org 10 Jan '19

10 Jan '19

Notification Type: ACKNOWLEDGEMENT Service: toolschecker: All Flannel etcd nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Thu Jan 10 10:38:08 UTC 2019 Notes URLs: Additional Info: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string OK not found on http://checker.tools.wmflabs.org:80/etcd/flannel - 341 bytes in 0.003 second response time

1 0

** ACKNOWLEDGEMENT alert - checker.tools.wmflabs.org/toolschecker service itself needs to return OK is CRITICAL **
by nagios＠icinga1001.wikimedia.org 10 Jan '19

10 Jan '19

Notification Type: ACKNOWLEDGEMENT Service: toolschecker service itself needs to return OK Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Thu Jan 10 10:38:07 UTC 2019 Notes URLs: Additional Info: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string OK not found on http://checker.tools.wmflabs.org:80/self - 341 bytes in 0.004 second response time

1 0

** PROBLEM alert - checker.tools.wmflabs.org/toolschecker: NFS read/writeable on labs instances is CRITICAL **
by nagios＠icinga1001.wikimedia.org 10 Jan '19

10 Jan '19

Notification Type: PROBLEM Service: toolschecker: NFS read/writeable on labs instances Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Thu Jan 10 10:37:00 UTC 2019 Notes URLs: Additional Info: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string OK not found on http://checker.tools.wmflabs.org:80/nfs/home - 341 bytes in 0.005 second response time

1 0

** PROBLEM alert - checker.tools.wmflabs.org/toolschecker: Verify internal DNS from within Tools is CRITICAL **
by nagios＠icinga1001.wikimedia.org 10 Jan '19

10 Jan '19

Notification Type: PROBLEM Service: toolschecker: Verify internal DNS from within Tools Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Thu Jan 10 10:36:52 UTC 2019 Notes URLs: Additional Info: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string OK not found on http://checker.tools.wmflabs.org:80/labs-dns/private - 341 bytes in 0.004 second response time

1 0

** PROBLEM alert - cloudvirt1024/ensure kvm processes are running is CRITICAL **
by nagios＠icinga1001.wikimedia.org 07 Jan '19

07 Jan '19

Notification Type: PROBLEM Service: ensure kvm processes are running Host: cloudvirt1024 Address: 10.64.20.43 State: CRITICAL Date/Time: Mon Jan 7 11:48:49 UTC 2019 Notes URLs: Additional Info: PROCS CRITICAL: 0 processes with regex args qemu-system-x86_64

1 0

** RECOVERY alert - cloudvirt1024/ensure kvm processes are running is OK **
by nagios＠icinga1001.wikimedia.org 07 Jan '19

07 Jan '19

Notification Type: RECOVERY Service: ensure kvm processes are running Host: cloudvirt1024 Address: 10.64.20.43 State: OK Date/Time: Mon Jan 7 11:46:21 UTC 2019 Notes URLs: Additional Info: PROCS OK: 2 processes with regex args qemu-system-x86_64

1 0

** ACKNOWLEDGEMENT alert - cloudvirt1024/ensure kvm processes are running is CRITICAL **
by nagios＠icinga1001.wikimedia.org 04 Jan '19

04 Jan '19

Notification Type: ACKNOWLEDGEMENT Service: ensure kvm processes are running Host: cloudvirt1024 Address: 10.64.20.43 State: CRITICAL Date/Time: Fri Jan 4 15:23:39 UTC 2019 Notes URLs: Additional Info: PROCS CRITICAL: 0 processes with regex args qemu-system-x86_64

1 0

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed January 2019