August 2022 - Cloud-admin-feed - lists.wikimedia.org

[FIRING:1] ProbeDown tools (172.16.4.136 ip4 tools-k8s-haproxy-4:30000 probes/custom http_this_tool_does_not_exist_toolforge_org_ip4 warning prometheus wmcs)

by root＠wmflabs.org

1 year, 8 months

1
0
0 0

[FIRING:2] ProbeDown tools (ip4 probes/custom http_this_tool_does_not_exist_toolforge_org_ip4 warning prometheus wmcs)

by root＠wmflabs.org

1 year, 8 months

1
0
0 0

** RECOVERY alert - checker.tools.wmflabs.org/toolschecker: start a job and verify on buster is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: toolschecker: start a job and verify on buster Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: OK Date/Time: Wed Aug 24 21:31:46 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 200 OK - 158 bytes in 0.810 second response time

1 year, 8 months

1
0
0 0

RECOVERY Host 2620:0:861:2:208:80:154:143 - PING WARNING - Packet loss = 75%, RTA = 0.20 ms

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Host: 2620:0:861:2:208:80:154:143 State: UP Address: 2620:0:861:2:208:80:154:143 Info: PING WARNING - Packet loss = 75%, RTA = 0.20 ms Date/Time: Wed Aug 24 21:29:50 UTC 2022 Acknowledged by :

1 year, 8 months

1
0
0 0

** RECOVERY alert - checker.tools.wmflabs.org/toolschecker: expect a long running job on buster is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: toolschecker: expect a long running job on buster Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: OK Date/Time: Wed Aug 24 21:23:58 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 200 OK - 158 bytes in 0.227 second response time

1 year, 8 months

1
0
0 0

** PROBLEM alert - checker.tools.wmflabs.org/toolschecker: start a job and verify on buster is CRITICAL **

by nagios＠alert1001.wikimedia.org

Notification Type: PROBLEM Service: toolschecker: start a job and verify on buster Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Wed Aug 24 21:21:30 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP CRITICAL: HTTP/1.1 503 SERVICE UNAVAILABLE - string OK not found on http://checker.tools.wmflabs.org:80/grid/start/buster - 177 bytes in 58.924 second response time

1 year, 8 months

1
0
0 0

ACKNOWLEDGEMENT Host 2620:0:861:2:208:80:154:143 - PING CRITICAL - Packet loss = 100%

by nagios＠alert1001.wikimedia.org

Notification Type: ACKNOWLEDGEMENT Host: 2620:0:861:2:208:80:154:143 State: DOWN Address: 2620:0:861:2:208:80:154:143 Info: PING CRITICAL - Packet loss = 100% Date/Time: Wed Aug 24 21:20:16 UTC 2022 Acknowledged by Andrew Bogott: switching off old cloudservices host

1 year, 8 months

1
0
0 0

** ACKNOWLEDGEMENT alert - 2620:0:861:2:208:80:154:143/Recursive DNS is CRITICAL **

by nagios＠alert1001.wikimedia.org

Notification Type: ACKNOWLEDGEMENT Service: Recursive DNS Host: 2620:0:861:2:208:80:154:143 Address: 2620:0:861:2:208:80:154:143 State: CRITICAL Date/Time: Wed Aug 24 21:20:16 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/DNS Acknowledged by Andrew Bogott: switching off old cloudservices host Additional Info: DNS_QUERY CRITICAL - query timed out

1 year, 8 months

1
0
0 0

PROBLEM Host 2620:0:861:2:208:80:154:143 - PING CRITICAL - Packet loss = 100%

by nagios＠alert1001.wikimedia.org

Notification Type: PROBLEM Host: 2620:0:861:2:208:80:154:143 State: DOWN Address: 2620:0:861:2:208:80:154:143 Info: PING CRITICAL - Packet loss = 100% Date/Time: Wed Aug 24 21:19:08 UTC 2022 Acknowledged by :

1 year, 8 months

1
0
0 0

** PROBLEM alert - checker.tools.wmflabs.org/toolschecker: expect a long running job on buster is CRITICAL **

by nagios＠alert1001.wikimedia.org

Notification Type: PROBLEM Service: toolschecker: expect a long running job on buster Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Wed Aug 24 21:18:54 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP CRITICAL: HTTP/1.1 504 Gateway Time-out - string OK not found on http://checker.tools.wmflabs.org:80/grid/continuous/buster - 340 bytes in 61.577 second response time

1 year, 8 months

1
0
0 0

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed August 2022