October 2019 - Cloud-admin-feed - lists.wikimedia.org

** RECOVERY alert - labstore1004/High 1m load average is OK **

by nagios＠icinga1001.wikimedia.org

Notification Type: RECOVERY Service: High 1m load average Host: labstore1004 Address: 10.64.37.19 State: OK Date/Time: Sat Oct 26 17:51:54 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: All metrics within thresholds.

4 years, 7 months

1
0
0 0

** PROBLEM alert - labstore1004/High 1m load average is CRITICAL **

by nagios＠icinga1001.wikimedia.org

Notification Type: PROBLEM Service: High 1m load average Host: labstore1004 Address: 10.64.37.19 State: CRITICAL Date/Time: Sat Oct 26 17:35:52 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: cluster=labsnfs instance=labstore1004:9100 job=node site=eqiad

4 years, 7 months

1
0
0 0

** RECOVERY alert - checker.tools.wmflabs.org/toolschecker: All k8s worker nodes are healthy is OK **

by nagios＠icinga1001.wikimedia.org

Notification Type: RECOVERY Service: toolschecker: All k8s worker nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: OK Date/Time: Fri Oct 25 07:27:08 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 200 OK - 158 bytes in 0.115 second response time

4 years, 7 months

1
0
0 0

** PROBLEM alert - checker.tools.wmflabs.org/toolschecker: All k8s worker nodes are healthy is CRITICAL **

by nagios＠icinga1001.wikimedia.org

Notification Type: PROBLEM Service: toolschecker: All k8s worker nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Fri Oct 25 07:15:58 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP CRITICAL: HTTP/1.1 503 SERVICE UNAVAILABLE - string OK not found on http://checker.tools.wmflabs.org:80/k8s/nodes/ready - 177 bytes in 0.139 second response time

4 years, 7 months

1
0
0 0

** RECOVERY alert - cloudvirt1018/MegaRAID is OK **

by nagios＠icinga1001.wikimedia.org

Notification Type: RECOVERY Service: MegaRAID Host: cloudvirt1018 Address: 10.64.20.34 State: OK Date/Time: Thu Oct 24 21:14:08 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/MegaCli%23Monitoring Acknowledged by : Additional Info: OK: optimal, 1 logical, 8 physical

4 years, 7 months

1
0
0 0

** ACKNOWLEDGEMENT alert - cloudvirt1018/MegaRAID is CRITICAL **

by nagios＠icinga1001.wikimedia.org

Notification Type: ACKNOWLEDGEMENT Service: MegaRAID Host: cloudvirt1018 Address: 10.64.20.34 State: CRITICAL Date/Time: Thu Oct 24 21:03:31 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/MegaCli%23Monitoring Acknowledged by nagiosadmin: RAID handler auto-ack: https://phabricator.wikimedia.org/T236438 Additional Info: CRITICAL: 1 failed LD(s) (Degraded)

4 years, 7 months

1
0
0 0

** RECOVERY alert - checker.tools.wmflabs.org/toolschecker: toolsdb read/write is OK **

by nagios＠icinga1001.wikimedia.org

Notification Type: RECOVERY Service: toolschecker: toolsdb read/write Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: OK Date/Time: Thu Oct 24 18:21:28 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 200 OK - 158 bytes in 0.029 second response time

4 years, 7 months

1
0
0 0

** PROBLEM alert - checker.tools.wmflabs.org/toolschecker: toolsdb read/write is CRITICAL **

by nagios＠icinga1001.wikimedia.org

Notification Type: PROBLEM Service: toolschecker: toolsdb read/write Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Thu Oct 24 18:15:14 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP CRITICAL: HTTP/1.1 504 Gateway Time-out - string OK not found on http://checker.tools.wmflabs.org:80/db/toolsdb - 340 bytes in 60.007 second response time

4 years, 7 months

1
0
0 0

** RECOVERY alert - checker.tools.wmflabs.org/toolschecker: toolsdb read/write is OK **

by nagios＠icinga1001.wikimedia.org

Notification Type: RECOVERY Service: toolschecker: toolsdb read/write Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: OK Date/Time: Thu Oct 24 17:27:35 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 200 OK - 158 bytes in 0.020 second response time

4 years, 7 months

1
0
0 0

** PROBLEM alert - checker.tools.wmflabs.org/toolschecker: toolsdb read/write is CRITICAL **

by nagios＠icinga1001.wikimedia.org

Notification Type: PROBLEM Service: toolschecker: toolsdb read/write Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Thu Oct 24 17:15:23 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP CRITICAL: HTTP/1.1 504 Gateway Time-out - string OK not found on http://checker.tools.wmflabs.org:80/db/toolsdb - 340 bytes in 60.005 second response time

4 years, 7 months

1
0
0 0

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed October 2019