August 2024 - Cloud-admin-feed - lists.wikimedia.org

[RESOLVED] InstanceDown cloudinfra (cloud-cumin-04 node warning wmcs)
by root＠wmflabs.org 07 Aug '24

07 Aug '24

1 0

** RECOVERY alert - checker.tools.wmflabs.org/toolschecker: NFS read/writeable on labs instances is OK **
by nagios＠alert1001.wikimedia.org 07 Aug '24

07 Aug '24

Notification Type: RECOVERY Service: toolschecker: NFS read/writeable on labs instances Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: OK Date/Time: Wed Aug 7 08:51:07 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 200 OK - 158 bytes in 21.072 second response time

1 0

[FIRING:1] ToolsToolsDBWritableState tools (page wmcs)
by root＠wmflabs.org 07 Aug '24

07 Aug '24

1 0

[FIRING:1] InstanceDown cloudinfra (cloud-cumin-04 node warning wmcs)
by root＠wmflabs.org 07 Aug '24

07 Aug '24

1 0

** PROBLEM alert - checker.tools.wmflabs.org/toolschecker: NFS read/writeable on labs instances is CRITICAL **
by nagios＠alert1001.wikimedia.org 07 Aug '24

07 Aug '24

Notification Type: PROBLEM Service: toolschecker: NFS read/writeable on labs instances Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Wed Aug 7 08:34:13 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP CRITICAL: HTTP/1.1 504 Gateway Time-out - string OK not found on http://checker.tools.wmflabs.org:80/nfs/home - 324 bytes in 60.015 second response time

1 0

[FIRING:3] ProbeDown tools (ip4 probes/custom warning prometheus wmcs)
by root＠wmflabs.org 07 Aug '24

07 Aug '24

1 0

RECOVERY Host cloudcephosd1035 - PING OK - Packet loss = 0%, RTA = 0.35 ms
by nagios＠alert1001.wikimedia.org 07 Aug '24

07 Aug '24

Notification Type: RECOVERY Host: cloudcephosd1035 State: UP Address: 10.64.151.7 Info: PING OK - Packet loss = 0%, RTA = 0.35 ms Date/Time: Wed Aug 7 07:52:35 UTC 2024 Acknowledged by :

1 0

PROBLEM Host cloudcephosd1035 - PING CRITICAL - Packet loss = 100%
by nagios＠alert1001.wikimedia.org 07 Aug '24

07 Aug '24

Notification Type: PROBLEM Host: cloudcephosd1035 State: DOWN Address: 10.64.151.7 Info: PING CRITICAL - Packet loss = 100% Date/Time: Wed Aug 7 07:40:01 UTC 2024 Acknowledged by :

1 0

RECOVERY Host cloudcephosd1035 - PING OK - Packet loss = 0%, RTA = 0.56 ms
by nagios＠alert1001.wikimedia.org 07 Aug '24

07 Aug '24

Notification Type: RECOVERY Host: cloudcephosd1035 State: UP Address: 10.64.151.7 Info: PING OK - Packet loss = 0%, RTA = 0.56 ms Date/Time: Wed Aug 7 07:18:29 UTC 2024 Acknowledged by :

1 0

PROBLEM Host cloudcephosd1035 - PING CRITICAL - Packet loss = 100%
by nagios＠alert1001.wikimedia.org 07 Aug '24

07 Aug '24

Notification Type: PROBLEM Host: cloudcephosd1035 State: DOWN Address: 10.64.151.7 Info: PING CRITICAL - Packet loss = 100% Date/Time: Wed Aug 7 07:16:01 UTC 2024 Acknowledged by :

1 0

2025

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed August 2024