April 2020 - Cloud-admin-feed - lists.wikimedia.org

** RECOVERY alert - cloudservices1003/Check systemd state is OK **
by nagios＠icinga1001.wikimedia.org 09 Apr '20

09 Apr '20

Notification Type: RECOVERY Service: Check systemd state Host: cloudservices1003 Address: 208.80.154.135 State: OK Date/Time: Wed Apr 8 20:12:33 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state Acknowledged by : Additional Info: OK - running: The system is fully operational

1 0

** PROBLEM alert - cloudservices1003/designate-worker process is CRITICAL **
by nagios＠icinga1001.wikimedia.org 09 Apr '20

09 Apr '20

Notification Type: PROBLEM Service: designate-worker process Host: cloudservices1003 Address: 208.80.154.135 State: CRITICAL Date/Time: Wed Apr 8 20:09:29 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting Acknowledged by : Additional Info: PROCS CRITICAL: 0 processes with regex args ^/usr/bin/python.* /usr/bin/designate-worker

1 0

** PROBLEM alert - cloudservices1003/Check systemd state is CRITICAL **
by nagios＠icinga1001.wikimedia.org 09 Apr '20

09 Apr '20

Notification Type: PROBLEM Service: Check systemd state Host: cloudservices1003 Address: 208.80.154.135 State: CRITICAL Date/Time: Wed Apr 8 20:08:53 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state Acknowledged by : Additional Info: CRITICAL - degraded: The system is operational but one or more units failed.

1 0

** RECOVERY alert - cloudservices1004/designate-producer process is OK **
by nagios＠icinga1001.wikimedia.org 08 Apr '20

08 Apr '20

Notification Type: RECOVERY Service: designate-producer process Host: cloudservices1004 Address: 208.80.154.11 State: OK Date/Time: Wed Apr 8 17:57:45 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting Acknowledged by : Additional Info: PROCS OK: 1 process with regex args ^/usr/bin/python.* /usr/bin/designate-producer

1 0

** RECOVERY alert - cloudservices1004/Check systemd state is OK **
by nagios＠icinga1001.wikimedia.org 08 Apr '20

08 Apr '20

Notification Type: RECOVERY Service: Check systemd state Host: cloudservices1004 Address: 208.80.154.11 State: OK Date/Time: Wed Apr 8 17:57:45 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state Acknowledged by : Additional Info: OK - running: The system is fully operational

1 0

** PROBLEM alert - cloudservices1004/designate-producer process is CRITICAL **
by nagios＠icinga1001.wikimedia.org 08 Apr '20

08 Apr '20

Notification Type: PROBLEM Service: designate-producer process Host: cloudservices1004 Address: 208.80.154.11 State: CRITICAL Date/Time: Wed Apr 8 17:55:17 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting Acknowledged by : Additional Info: PROCS CRITICAL: 0 processes with regex args ^/usr/bin/python.* /usr/bin/designate-producer

1 0

** PROBLEM alert - cloudservices1004/Check systemd state is CRITICAL **
by nagios＠icinga1001.wikimedia.org 08 Apr '20

08 Apr '20

Notification Type: PROBLEM Service: Check systemd state Host: cloudservices1004 Address: 208.80.154.11 State: CRITICAL Date/Time: Wed Apr 8 17:55:17 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state Acknowledged by : Additional Info: CRITICAL - degraded: The system is operational but one or more units failed.

1 0

** RECOVERY alert - labstore1007/High 1m load average is OK **
by nagios＠icinga1001.wikimedia.org 08 Apr '20

08 Apr '20

Notification Type: RECOVERY Service: High 1m load average Host: labstore1007 Address: 208.80.155.106 State: OK Date/Time: Wed Apr 8 01:29:34 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: All metrics within thresholds.

1 0

** PROBLEM alert - labstore1007/High 1m load average is CRITICAL **
by nagios＠icinga1001.wikimedia.org 08 Apr '20

08 Apr '20

Notification Type: PROBLEM Service: High 1m load average Host: labstore1007 Address: 208.80.155.106 State: CRITICAL Date/Time: Wed Apr 8 01:04:12 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: cluster=wmcs instance=labstore1007:9100 job=node site=eqiad

1 0

** PROBLEM alert - labstore1007/High 1m load average is CRITICAL **
by nagios＠icinga1001.wikimedia.org 08 Apr '20

08 Apr '20

Notification Type: PROBLEM Service: High 1m load average Host: labstore1007 Address: 208.80.155.106 State: CRITICAL Date/Time: Wed Apr 8 00:55:08 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: cluster=wmcs instance=labstore1007:9100 job=node site=eqiad

1 0

2026

2025

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed April 2020