February 2020 - Cloud-admin-feed - lists.wikimedia.org

** ACKNOWLEDGEMENT alert - checker.tools.wmflabs.org/toolschecker: start a job and verify on stretch is CRITICAL **
by nagios＠icinga1001.wikimedia.org 26 Feb '20

26 Feb '20

Notification Type: ACKNOWLEDGEMENT Service: toolschecker: start a job and verify on stretch Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Wed Feb 26 20:23:47 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/portal:toolforge/admin/toolschecker Acknowledged by daniel_zahn: maintenance ongoing Additional Info: HTTP CRITICAL: HTTP/1.1 503 SERVICE UNAVAILABLE - string OK not found on http://checker.tools.wmflabs.org:80/grid/start/stretch - 177 bytes in 0.202 second response time

1 0

** ACKNOWLEDGEMENT alert - checker.tools.wmflabs.org/toolschecker: expect a long running job on stretch is CRITICAL **
by nagios＠icinga1001.wikimedia.org 26 Feb '20

26 Feb '20

Notification Type: ACKNOWLEDGEMENT Service: toolschecker: expect a long running job on stretch Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Wed Feb 26 20:23:47 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/portal:toolforge/admin/toolschecker Acknowledged by daniel_zahn: maintenance ongoing Additional Info: HTTP CRITICAL: HTTP/1.1 503 SERVICE UNAVAILABLE - string OK not found on http://checker.tools.wmflabs.org:80/grid/continuous/stretch - 177 bytes in 0.025 second response time

1 0

** ACKNOWLEDGEMENT alert - checker.tools.wmflabs.org/toolschecker: check mtime mod from tools cron job is CRITICAL **
by nagios＠icinga1001.wikimedia.org 26 Feb '20

26 Feb '20

Notification Type: ACKNOWLEDGEMENT Service: toolschecker: check mtime mod from tools cron job Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Wed Feb 26 20:05:22 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by daniel_zahn: NFS maintenance ongoing Additional Info: HTTP CRITICAL: HTTP/1.1 503 SERVICE UNAVAILABLE - string OK not found on http://checker.tools.wmflabs.org:80/cron - 177 bytes in 0.005 second response time

1 0

** PROBLEM alert - checker.tools.wmflabs.org/toolschecker: check mtime mod from tools cron job is CRITICAL **
by nagios＠icinga1001.wikimedia.org 26 Feb '20

26 Feb '20

Notification Type: PROBLEM Service: toolschecker: check mtime mod from tools cron job Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Wed Feb 26 20:03:09 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP CRITICAL: HTTP/1.1 503 SERVICE UNAVAILABLE - string OK not found on http://checker.tools.wmflabs.org:80/cron - 177 bytes in 0.004 second response time

1 0

** RECOVERY alert - cloudvirt1001/nova-compute proc minimum is OK **
by nagios＠icinga1001.wikimedia.org 25 Feb '20

25 Feb '20

Notification Type: RECOVERY Service: nova-compute proc minimum Host: cloudvirt1001 Address: 10.64.20.19 State: OK Date/Time: Tue Feb 25 22:35:16 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting Acknowledged by : Additional Info: PROCS OK: 1 process with regex args ^/usr/bin/pytho[n].* /usr/bin/nova-compute

1 0

** PROBLEM alert - cloudvirt1001/nova-compute proc minimum is CRITICAL **
by nagios＠icinga1001.wikimedia.org 25 Feb '20

25 Feb '20

Notification Type: PROBLEM Service: nova-compute proc minimum Host: cloudvirt1001 Address: 10.64.20.19 State: CRITICAL Date/Time: Tue Feb 25 22:33:06 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting Acknowledged by : Additional Info: PROCS CRITICAL: 0 processes with regex args ^/usr/bin/pytho[n].* /usr/bin/nova-compute

1 0

** RECOVERY alert - cloudcontrol1003/Check systemd state is OK **
by nagios＠icinga1001.wikimedia.org 25 Feb '20

25 Feb '20

Notification Type: RECOVERY Service: Check systemd state Host: cloudcontrol1003 Address: 208.80.154.23 State: OK Date/Time: Tue Feb 25 21:35:22 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state Acknowledged by : Additional Info: OK - running: The system is fully operational

1 0

** PROBLEM alert - cloudcontrol1003/Check systemd state is CRITICAL **
by nagios＠icinga1001.wikimedia.org 25 Feb '20

25 Feb '20

Notification Type: PROBLEM Service: Check systemd state Host: cloudcontrol1003 Address: 208.80.154.23 State: CRITICAL Date/Time: Tue Feb 25 21:19:46 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state Acknowledged by : Additional Info: CRITICAL - degraded: The system is operational but one or more units failed.

1 0

** RECOVERY alert - cloudvirt1014/Check systemd state is OK **
by nagios＠icinga1001.wikimedia.org 25 Feb '20

25 Feb '20

Notification Type: RECOVERY Service: Check systemd state Host: cloudvirt1014 Address: 10.64.20.30 State: OK Date/Time: Tue Feb 25 16:23:47 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state Acknowledged by : Additional Info: OK - running: The system is fully operational

1 0

** RECOVERY alert - cloudvirt1028/Check systemd state is OK **
by nagios＠icinga1001.wikimedia.org 25 Feb '20

25 Feb '20

Notification Type: RECOVERY Service: Check systemd state Host: cloudvirt1028 Address: 10.64.20.52 State: OK Date/Time: Tue Feb 25 16:23:46 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state Acknowledged by : Additional Info: OK - running: The system is fully operational

1 0

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed February 2020