November 2019 - Cloud-admin-feed - lists.wikimedia.org

** PROBLEM alert - labstore1007/High 1m load average is CRITICAL **
by nagios＠icinga1001.wikimedia.org 09 Nov '19

09 Nov '19

Notification Type: PROBLEM Service: High 1m load average Host: labstore1007 Address: 208.80.155.106 State: CRITICAL Date/Time: Sat Nov 9 22:53:01 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: cluster=wmcs instance=labstore1007:9100 job=node site=eqiad

1 0

** RECOVERY alert - labstore1007/High 1m load average is OK **
by nagios＠icinga1001.wikimedia.org 09 Nov '19

09 Nov '19

Notification Type: RECOVERY Service: High 1m load average Host: labstore1007 Address: 208.80.155.106 State: OK Date/Time: Sat Nov 9 21:52:25 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: All metrics within thresholds.

1 0

** PROBLEM alert - labstore1007/High 1m load average is CRITICAL **
by nagios＠icinga1001.wikimedia.org 09 Nov '19

09 Nov '19

Notification Type: PROBLEM Service: High 1m load average Host: labstore1007 Address: 208.80.155.106 State: CRITICAL Date/Time: Sat Nov 9 21:47:35 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: cluster=wmcs instance=labstore1007:9100 job=node site=eqiad

1 0

** RECOVERY alert - labstore1007/High 1m load average is OK **
by nagios＠icinga1001.wikimedia.org 09 Nov '19

09 Nov '19

Notification Type: RECOVERY Service: High 1m load average Host: labstore1007 Address: 208.80.155.106 State: OK Date/Time: Sat Nov 9 20:40:43 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: All metrics within thresholds.

1 0

** PROBLEM alert - labstore1007/High 1m load average is CRITICAL **
by nagios＠icinga1001.wikimedia.org 09 Nov '19

09 Nov '19

Notification Type: PROBLEM Service: High 1m load average Host: labstore1007 Address: 208.80.155.106 State: CRITICAL Date/Time: Sat Nov 9 20:11:59 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: cluster=wmcs instance=labstore1007:9100 job=node site=eqiad

1 0

** RECOVERY alert - labstore1007/High 1m load average is OK **
by nagios＠icinga1001.wikimedia.org 08 Nov '19

08 Nov '19

Notification Type: RECOVERY Service: High 1m load average Host: labstore1007 Address: 208.80.155.106 State: OK Date/Time: Fri Nov 8 09:39:09 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: All metrics within thresholds.

1 0

** PROBLEM alert - labstore1007/High 1m load average is CRITICAL **
by nagios＠icinga1001.wikimedia.org 08 Nov '19

08 Nov '19

Notification Type: PROBLEM Service: High 1m load average Host: labstore1007 Address: 208.80.155.106 State: CRITICAL Date/Time: Fri Nov 8 09:31:11 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: cluster=wmcs instance=labstore1007:9100 job=node site=eqiad

1 0

** RECOVERY alert - cloudbackup2002/Check the last execution of block_sync-misc-project is OK **
by nagios＠icinga1001.wikimedia.org 07 Nov '19

07 Nov '19

Notification Type: RECOVERY Service: Check the last execution of block_sync-misc-project Host: cloudbackup2002 Address: 10.192.32.186 State: OK Date/Time: Thu Nov 7 15:33:31 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_time… Acknowledged by : Additional Info: OK: Status of the systemd unit block_sync-misc-project

1 0

** RECOVERY alert - cloudbackup2002/Check systemd state is OK **
by nagios＠icinga1001.wikimedia.org 07 Nov '19

07 Nov '19

Notification Type: RECOVERY Service: Check systemd state Host: cloudbackup2002 Address: 10.192.32.186 State: OK Date/Time: Thu Nov 7 15:30:13 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state Acknowledged by : Additional Info: OK - running: The system is fully operational

1 0

** RECOVERY alert - checker.tools.wmflabs.org/toolschecker: All k8s worker nodes are healthy is OK **
by nagios＠icinga1001.wikimedia.org 06 Nov '19

06 Nov '19

Notification Type: RECOVERY Service: toolschecker: All k8s worker nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: OK Date/Time: Wed Nov 6 22:03:22 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 200 OK - 158 bytes in 0.213 second response time

1 0

2025

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed November 2019