Discovery-alerts June 2026

discovery-alerts@lists.wikimedia.org

3 participants
502 discussions

[FIRING:1] CirrusSearchThreadPoolRejectionsTooHigh elasticsearch search-platform (true true true false production-search-eqiad 10.64.16.64 cirrussearch1086:9108 elasticsearch cirrussearch1086-production-search-eqiad ops critical eqiad prometheus search)
by sre-observability＠wikimedia.org 30 Jun '26

30 Jun '26

1 0

[FIRING:2] CirrusSearchMoreLikeLatencyTooHigh search-platform (k8s dnsdisc critical prometheus)
by sre-observability＠wikimedia.org 30 Jun '26

30 Jun '26

1 0

[FIRING:2] CirrusSearchFullTextLatencyTooHigh search-platform (k8s dnsdisc critical prometheus)
by sre-observability＠wikimedia.org 30 Jun '26

30 Jun '26

1 0

RECOVERY Host cirrussearch2089 - PING OK - Packet loss = 0%, RTA = 32.92 ms
by nagios＠alert1002.wikimedia.org 30 Jun '26

30 Jun '26

Notification Type: RECOVERY Host: cirrussearch2089 State: UP Address: 10.192.6.18 Info: PING OK - Packet loss = 0%, RTA = 32.92 ms Date/Time: Tue Jun 30 19:43:19 UTC 2026 Acknowledged by :

1 0

[FIRING:1] CirrusSearchCompletionLatencyTooHigh search-platform (k8s dnsdisc critical eqiad prometheus)
by sre-observability＠wikimedia.org 30 Jun '26

30 Jun '26

1 0

[FIRING:1] CirrusSearchMoreLikeLatencyTooHigh search-platform (k8s dnsdisc critical codfw prometheus)
by sre-observability＠wikimedia.org 30 Jun '26

30 Jun '26

1 0

[FIRING:1] CirrusSearchCompletionLatencyTooHigh search-platform (k8s dnsdisc critical codfw prometheus)
by sre-observability＠wikimedia.org 30 Jun '26

30 Jun '26

1 0

PROBLEM Host cirrussearch2089 - PING CRITICAL - Packet loss = 100%
by nagios＠alert1002.wikimedia.org 30 Jun '26

30 Jun '26

Notification Type: PROBLEM Host: cirrussearch2089 State: DOWN Address: 10.192.6.18 Info: PING CRITICAL - Packet loss = 100% Date/Time: Tue Jun 30 19:17:49 UTC 2026 Acknowledged by :

1 0

** RECOVERY alert - cirrussearch2065/Elasticsearch HTTPS for production-search-codfw is OK **
by nagios＠alert1002.wikimedia.org 30 Jun '26

30 Jun '26

Notification Type: RECOVERY Service: Elasticsearch HTTPS for production-search-codfw Host: cirrussearch2065 Address: 10.192.28.14 State: OK Date/Time: Tue Jun 30 18:28:39 UTC 2026 Notes URLs: https://wikitech.wikimedia.org/wiki/Search Acknowledged by : Additional Info: SSL OK - Certificate cirrussearch2065.codfw.wmnet valid until 2026-07-28 18:23:00 +0000 (expires in 27 days)

1 0

** PROBLEM alert - cirrussearch2065/Elasticsearch HTTPS for production-search-codfw is CRITICAL **
by nagios＠alert1002.wikimedia.org 30 Jun '26

30 Jun '26

Notification Type: PROBLEM Service: Elasticsearch HTTPS for production-search-codfw Host: cirrussearch2065 Address: 10.192.28.14 State: CRITICAL Date/Time: Tue Jun 30 18:18:36 UTC 2026 Notes URLs: https://wikitech.wikimedia.org/wiki/Search Acknowledged by : Additional Info: SSL CRITICAL - failed to connect or SSL handshake:Connection refused

1 0

Jump to page:

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

Discovery-alerts June 2026