April 2020 - Cloud-admin-feed - lists.wikimedia.org

[FIRING:1] InstanceDown tools_node (tools-sgeexec-0936 warn)
by root＠wmflabs.org 27 Apr '20

27 Apr '20

1 0

[FIRING:1] PuppetAgentFailures tools_node (tools-k8s-worker-16 warning)
by root＠wmflabs.org 27 Apr '20

27 Apr '20

1 0

** RECOVERY alert - labsdb1011/Check systemd state is OK **
by nagios＠icinga1001.wikimedia.org 27 Apr '20

27 Apr '20

Notification Type: RECOVERY Service: Check systemd state Host: labsdb1011 Address: 10.64.37.24 State: OK Date/Time: Mon Apr 27 09:03:50 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state Acknowledged by : Additional Info: OK - running: The system is fully operational

1 0

** PROBLEM alert - labsdb1011/Check systemd state is CRITICAL **
by nagios＠icinga1001.wikimedia.org 27 Apr '20

27 Apr '20

Notification Type: PROBLEM Service: Check systemd state Host: labsdb1011 Address: 10.64.37.24 State: CRITICAL Date/Time: Mon Apr 27 09:00:12 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state Acknowledged by : Additional Info: CRITICAL - degraded: The system is operational but one or more units failed.

1 0

Host UP alert for wikitech-static.wikimedia.org!
by nagios＠icinga1001.wikimedia.org 24 Apr '20

24 Apr '20

Notification Type: RECOVERY Host: wikitech-static.wikimedia.org State: UP Address: wikitech-static.wikimedia.org Info: PING OK - Packet loss = 0%, RTA = 23.28 ms Date/Time: Fri Apr 24 23:28:58 UTC 2020 Acknowledged by :

1 0

Host DOWN alert for wikitech-static.wikimedia.org!
by nagios＠icinga1001.wikimedia.org 24 Apr '20

24 Apr '20

Notification Type: PROBLEM Host: wikitech-static.wikimedia.org State: DOWN Address: wikitech-static.wikimedia.org Info: PING CRITICAL - Packet loss = 100% Date/Time: Fri Apr 24 23:28:14 UTC 2020 Acknowledged by :

1 0

** RECOVERY alert - labstore1007/High 1m load average is OK **
by nagios＠icinga1001.wikimedia.org 23 Apr '20

23 Apr '20

Notification Type: RECOVERY Service: High 1m load average Host: labstore1007 Address: 208.80.155.106 State: OK Date/Time: Thu Apr 23 22:25:38 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: All metrics within thresholds.

1 0

** PROBLEM alert - labstore1007/High 1m load average is CRITICAL **
by nagios＠icinga1001.wikimedia.org 23 Apr '20

23 Apr '20

Notification Type: PROBLEM Service: High 1m load average Host: labstore1007 Address: 208.80.155.106 State: CRITICAL Date/Time: Thu Apr 23 22:06:52 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: cluster=wmcs instance=labstore1007:9100 job=node site=eqiad

1 0

** RECOVERY alert - labstore1007/High 1m load average is OK **
by nagios＠icinga1001.wikimedia.org 23 Apr '20

23 Apr '20

Notification Type: RECOVERY Service: High 1m load average Host: labstore1007 Address: 208.80.155.106 State: OK Date/Time: Thu Apr 23 19:30:38 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: All metrics within thresholds.

1 0

** PROBLEM alert - labstore1007/High 1m load average is CRITICAL **
by nagios＠icinga1001.wikimedia.org 23 Apr '20

23 Apr '20

Notification Type: PROBLEM Service: High 1m load average Host: labstore1007 Address: 208.80.155.106 State: CRITICAL Date/Time: Thu Apr 23 19:17:40 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: cluster=wmcs instance=labstore1007:9100 job=node site=eqiad

1 0

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed April 2020