September 2019 - Cloud-admin-feed

** PROBLEM alert - labpuppetmaster1002/Unmerged changes on repository puppet is CRITICAL **
by nagios＠icinga1001.wikimedia.org 04 Sep '19

04 Sep '19

Notification Type: PROBLEM Service: Unmerged changes on repository puppet Host: labpuppetmaster1002 Address: 208.80.155.120 State: CRITICAL Date/Time: Wed Sept 4 12:01:39 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/unmerged_changes Acknowledged by : Additional Info: There is one unmerged change in puppet (dir /var/lib/git/operations/puppet, ref HEAD..origin/production).

1 0

** PROBLEM alert - labpuppetmaster1001/Unmerged changes on repository puppet is CRITICAL **
by nagios＠icinga1001.wikimedia.org 04 Sep '19

04 Sep '19

Notification Type: PROBLEM Service: Unmerged changes on repository puppet Host: labpuppetmaster1001 Address: 208.80.154.158 State: CRITICAL Date/Time: Wed Sept 4 11:58:25 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/unmerged_changes Acknowledged by : Additional Info: There is one unmerged change in puppet (dir /var/lib/git/operations/puppet, ref HEAD..origin/production).

1 0

** RECOVERY alert - checker.tools.wmflabs.org/toolschecker: All k8s worker nodes are healthy is OK **
by nagios＠icinga1001.wikimedia.org 04 Sep '19

04 Sep '19

Notification Type: RECOVERY Service: toolschecker: All k8s worker nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: OK Date/Time: Wed Sept 4 11:18:00 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 200 OK - 158 bytes in 0.111 second response time

1 0

** PROBLEM alert - checker.tools.wmflabs.org/toolschecker: All k8s worker nodes are healthy is CRITICAL **
by nagios＠icinga1001.wikimedia.org 04 Sep '19

04 Sep '19

Notification Type: PROBLEM Service: toolschecker: All k8s worker nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Wed Sept 4 11:12:42 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP CRITICAL: HTTP/1.1 503 SERVICE UNAVAILABLE - string OK not found on http://checker.tools.wmflabs.org:80/k8s/nodes/ready - 177 bytes in 0.143 second response time

1 0

** RECOVERY alert - cloudstore1008/Ensure NFS exports are maintained for new instances with NFS is OK **
by nagios＠icinga1001.wikimedia.org 03 Sep '19

03 Sep '19

Notification Type: RECOVERY Service: Ensure NFS exports are maintained for new instances with NFS Host: cloudstore1008 Address: 208.80.155.125 State: OK Date/Time: Tue Sept 3 13:27:50 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state Acknowledged by : Additional Info: OK - nfs-exportd is active

1 0

** RECOVERY alert - labstore1004/Ensure NFS exports are maintained for new instances with NFS is OK **
by nagios＠icinga1001.wikimedia.org 03 Sep '19

03 Sep '19

Notification Type: RECOVERY Service: Ensure NFS exports are maintained for new instances with NFS Host: labstore1004 Address: 10.64.37.19 State: OK Date/Time: Tue Sept 3 13:27:24 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state Acknowledged by : Additional Info: OK - nfs-exportd is active

1 0

** RECOVERY alert - labstore1005/Ensure NFS exports are maintained for new instances with NFS is OK **
by nagios＠icinga1001.wikimedia.org 03 Sep '19

03 Sep '19

Notification Type: RECOVERY Service: Ensure NFS exports are maintained for new instances with NFS Host: labstore1005 Address: 10.64.37.20 State: OK Date/Time: Tue Sept 3 13:25:54 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state Acknowledged by : Additional Info: OK - nfs-exportd is active

1 0

** RECOVERY alert - cloudstore1009/Ensure NFS exports are maintained for new instances with NFS is OK **
by nagios＠icinga1001.wikimedia.org 03 Sep '19

03 Sep '19

Notification Type: RECOVERY Service: Ensure NFS exports are maintained for new instances with NFS Host: cloudstore1009 Address: 208.80.155.126 State: OK Date/Time: Tue Sept 3 13:24:44 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state Acknowledged by : Additional Info: OK - nfs-exportd is active

1 0

** PROBLEM alert - cloudstore1008/Ensure NFS exports are maintained for new instances with NFS is CRITICAL **
by nagios＠icinga1001.wikimedia.org 03 Sep '19

03 Sep '19

Notification Type: PROBLEM Service: Ensure NFS exports are maintained for new instances with NFS Host: cloudstore1008 Address: 208.80.155.125 State: CRITICAL Date/Time: Tue Sept 3 13:18:16 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state Acknowledged by : Additional Info: CRITICAL - Expecting active but unit nfs-exportd is activating

1 0

** PROBLEM alert - labstore1005/Ensure NFS exports are maintained for new instances with NFS is CRITICAL **
by nagios＠icinga1001.wikimedia.org 03 Sep '19

03 Sep '19

Notification Type: PROBLEM Service: Ensure NFS exports are maintained for new instances with NFS Host: labstore1005 Address: 10.64.37.20 State: CRITICAL Date/Time: Tue Sept 3 13:17:58 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state Acknowledged by : Additional Info: CRITICAL - Expecting active but unit nfs-exportd is activating

1 0

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed September 2019