2024

2023

2022

2021

2020

2019

2018

2017

2016

List overview
Download

Discovery-alerts December 2022

discovery-alerts@lists.wikimedia.org

4 participants
178 discussions

Start a nNew thread

[FIRING:2] BlazegraphFreeAllocatorsDecreasingRapidly wdqs (blazegraph ops critical eqiad prometheus search-platform)
by sre-observability＠wikimedia.org 30 Dec '22

30 Dec '22

1 0

[FIRING:1] BlazegraphFreeAllocatorsDecreasingRapidly wdqs (wdqs1013:9193 blazegraph ops critical eqiad prometheus search-platform)
by sre-observability＠wikimedia.org 30 Dec '22

30 Dec '22

1 0

[FIRING:1] BlazegraphFreeAllocatorsDecreasingRapidly wdqs (wdqs1013:9193 blazegraph ops critical eqiad prometheus search-platform)
by sre-observability＠wikimedia.org 30 Dec '22

30 Dec '22

1 0

** RECOVERY alert - graphite1004/CirrusSearch eqiad 95th percentile latency is OK **
by nagios＠alert1001.wikimedia.org 29 Dec '22

29 Dec '22

Notification Type: RECOVERY Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: OK Date/Time: Thu Dec 29 21:44:44 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/d/000000455/elasticsearch-percentiles?orgId=1… Acknowledged by : Additional Info: OK: Less than 20.00% above the threshold [500.0]

1 0

** PROBLEM alert - graphite1004/CirrusSearch eqiad 95th percentile latency is CRITICAL **
by nagios＠alert1001.wikimedia.org 29 Dec '22

29 Dec '22

Notification Type: PROBLEM Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: CRITICAL Date/Time: Thu Dec 29 21:25:34 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/d/000000455/elasticsearch-percentiles?orgId=1… Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [1000.0]

1 0

** PROBLEM alert - graphite1004/CirrusSearch eqiad 95th percentile latency is CRITICAL **
by nagios＠alert1001.wikimedia.org 29 Dec '22

29 Dec '22

Notification Type: PROBLEM Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: CRITICAL Date/Time: Thu Dec 29 19:59:52 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/d/000000455/elasticsearch-percentiles?orgId=1… Acknowledged by : Additional Info: CRITICAL: 30.00% of data above the critical threshold [1000.0]

1 0

** RECOVERY alert - alert1001/Mediawiki CirrusSearch pool counter rejections rate is OK **
by nagios＠alert1001.wikimedia.org 29 Dec '22

29 Dec '22

Notification Type: RECOVERY Service: Mediawiki CirrusSearch pool counter rejections rate Host: alert1001 Address: 208.80.154.88 State: OK Date/Time: Thu Dec 29 15:35:32 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Pool_Counter_rejections_%28sea… https://grafana.wikimedia.org/d/qrOStmdGk/elasticsearch-pool-counters?viewP… Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [500.0]

1 0

** PROBLEM alert - alert1001/Mediawiki CirrusSearch pool counter rejections rate is CRITICAL **
by nagios＠alert1001.wikimedia.org 29 Dec '22

29 Dec '22

Notification Type: PROBLEM Service: Mediawiki CirrusSearch pool counter rejections rate Host: alert1001 Address: 208.80.154.88 State: CRITICAL Date/Time: Thu Dec 29 15:18:16 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Pool_Counter_rejections_%28sea… https://grafana.wikimedia.org/d/qrOStmdGk/elasticsearch-pool-counters?viewP… Acknowledged by : Additional Info: CRITICAL: 60.00% of data above the critical threshold [1000.0]

1 0

[airflow] SLA miss on DAG=transfer_to_es_weekly
by noreply＠wikimedia.org 26 Dec '22

26 Dec '22

1 0

[airflow] SLA miss on DAG=incoming_links_weekly
by noreply＠wikimedia.org 25 Dec '22

25 Dec '22

1 0

Jump to page: