2024

2023

2022

2021

2020

2019

2018

2017

2016

List overview
Download

Discovery-alerts March 2024

discovery-alerts@lists.wikimedia.org

5 participants
243 discussions

Start a nNew thread

[FIRING:1] SystemdUnitFailed search-platform (wdqs1013:9100 wdqs-updater.service ops critical eqiad prometheus)
by sre-observability＠wikimedia.org 26 Mar '24

26 Mar '24

1 0

[FIRING:2] RdfStreamingUpdaterHighConsumerUpdateLag wdqs search-platform (wdqs1013:9101 jmx_query_service_streaming_updater thanos-rule warning thanos)
by sre-observability＠wikimedia.org 26 Mar '24

26 Mar '24

1 0

[FIRING:2] ProbeDown search-platform (wdqs1013:443 probes/custom ops info eqiad prometheus)
by sre-observability＠wikimedia.org 26 Mar '24

26 Mar '24

1 0

[FIRING:2] ProbeDown search-platform (wdqs1013:443 probes/custom ops info eqiad prometheus)
by sre-observability＠wikimedia.org 26 Mar '24

26 Mar '24

1 0

[FIRING:2] ProbeDown search-platform (wdqs1013:443 probes/custom ops info eqiad prometheus)
by sre-observability＠wikimedia.org 25 Mar '24

25 Mar '24

1 0

** RECOVERY alert - graphite1005/CirrusSearch full_text eqiad 95th percentile latency is OK **
by nagios＠alert1001.wikimedia.org 25 Mar '24

25 Mar '24

Notification Type: RECOVERY Service: CirrusSearch full_text eqiad 95th percentile latency Host: graphite1005 Address: 10.64.16.81 State: OK Date/Time: Mon Mar 25 20:58:52 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/d/000000455/elasticsearch-percentiles?orgId=1… Acknowledged by : Additional Info: OK: Less than 20.00% above the threshold [500.0]

1 0

** RECOVERY alert - graphite1005/CirrusSearch more_like eqiad 95th percentile latency is OK **
by nagios＠alert1001.wikimedia.org 25 Mar '24

25 Mar '24

Notification Type: RECOVERY Service: CirrusSearch more_like eqiad 95th percentile latency Host: graphite1005 Address: 10.64.16.81 State: OK Date/Time: Mon Mar 25 20:58:46 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/d/000000455/elasticsearch-percentiles?orgId=1… Acknowledged by : Additional Info: OK: Less than 20.00% above the threshold [1000.0]

1 0

** PROBLEM alert - graphite1005/CirrusSearch more_like eqiad 95th percentile latency is CRITICAL **
by nagios＠alert1001.wikimedia.org 25 Mar '24

25 Mar '24

Notification Type: PROBLEM Service: CirrusSearch more_like eqiad 95th percentile latency Host: graphite1005 Address: 10.64.16.81 State: CRITICAL Date/Time: Mon Mar 25 20:50:46 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/d/000000455/elasticsearch-percentiles?orgId=1… Acknowledged by : Additional Info: CRITICAL: 30.00% of data above the critical threshold [1500.0]

1 0

** PROBLEM alert - graphite1005/CirrusSearch full_text eqiad 95th percentile latency is CRITICAL **
by nagios＠alert1001.wikimedia.org 25 Mar '24

25 Mar '24

Notification Type: PROBLEM Service: CirrusSearch full_text eqiad 95th percentile latency Host: graphite1005 Address: 10.64.16.81 State: CRITICAL Date/Time: Mon Mar 25 20:47:52 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/d/000000455/elasticsearch-percentiles?orgId=1… Acknowledged by : Additional Info: CRITICAL: 40.00% of data above the critical threshold [1000.0]

1 0

** RECOVERY alert - graphite1005/CirrusSearch full_text eqiad 95th percentile latency is OK **
by nagios＠alert1001.wikimedia.org 25 Mar '24

25 Mar '24

Notification Type: RECOVERY Service: CirrusSearch full_text eqiad 95th percentile latency Host: graphite1005 Address: 10.64.16.81 State: OK Date/Time: Mon Mar 25 20:34:52 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/d/000000455/elasticsearch-percentiles?orgId=1… Acknowledged by : Additional Info: OK: Less than 20.00% above the threshold [500.0]

1 0

← Newer
1
...
7
8
9
10
11
12
13
...
25
Older →

Jump to page: