2024

2023

2022

2021

2020

2019

2018

2017

2016

List overview
Download

Discovery-alerts August 2021

discovery-alerts@lists.wikimedia.org

3 participants
149 discussions

Start a nNew thread

** PROBLEM alert - elastic2053/Rate of JVM GC Old generation-s runs - elastic2053-production-search-psi-codfw is CRITICAL **
by nagios＠alert1001.wikimedia.org 29 Aug '21

29 Aug '21

Notification Type: PROBLEM Service: Rate of JVM GC Old generation-s runs - elastic2053-production-search-psi-codfw Host: elastic2053 Address: 10.192.48.129 State: CRITICAL Date/Time: Sun Aug 29 05:34:33 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Using_jstack_or_jmap_or_other_… https://grafana.wikimedia.org/d/000000462/elasticsearch-memory?orgId=1&var-… Acknowledged by : Additional Info: 102.7 gt 100

1 0

** PROBLEM alert - elastic2053/Rate of JVM GC Old generation-s runs - elastic2053-production-search-psi-codfw is CRITICAL **
by nagios＠alert1001.wikimedia.org 29 Aug '21

29 Aug '21

Notification Type: PROBLEM Service: Rate of JVM GC Old generation-s runs - elastic2053-production-search-psi-codfw Host: elastic2053 Address: 10.192.48.129 State: CRITICAL Date/Time: Sun Aug 29 04:44:53 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Using_jstack_or_jmap_or_other_… https://grafana.wikimedia.org/d/000000462/elasticsearch-memory?orgId=1&var-… Acknowledged by : Additional Info: 124.1 gt 100

1 0

** PROBLEM alert - elastic2044/Rate of JVM GC Old generation-s runs - elastic2044-production-search-psi-codfw is CRITICAL **
by nagios＠alert1001.wikimedia.org 29 Aug '21

29 Aug '21

Notification Type: PROBLEM Service: Rate of JVM GC Old generation-s runs - elastic2044-production-search-psi-codfw Host: elastic2044 Address: 10.192.16.91 State: CRITICAL Date/Time: Sun Aug 29 04:36:57 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Using_jstack_or_jmap_or_other_… https://grafana.wikimedia.org/d/000000462/elasticsearch-memory?orgId=1&var-… Acknowledged by : Additional Info: 119 gt 100

1 0

Airflow alert: <TaskInstance: search_satisfaction_daily.index_into_druid 2021-08-28T00:00:00+00:00 [failed]>
by noreply＠wikimedia.org 29 Aug '21

29 Aug '21

1 0

** RECOVERY alert - graphite1004/CirrusSearch eqiad 95th percentile latency is OK **
by nagios＠alert1001.wikimedia.org 29 Aug '21

29 Aug '21

Notification Type: RECOVERY Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: OK Date/Time: Sun Aug 29 03:29:59 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Acknowledged by : Additional Info: OK: Less than 20.00% above the threshold [500.0]

1 0

** RECOVERY alert - elastic2053/Rate of JVM GC Old generation-s runs - elastic2053-production-search-psi-codfw is OK **
by nagios＠alert1001.wikimedia.org 29 Aug '21

29 Aug '21

Notification Type: RECOVERY Service: Rate of JVM GC Old generation-s runs - elastic2053-production-search-psi-codfw Host: elastic2053 Address: 10.192.48.129 State: OK Date/Time: Sun Aug 29 03:18:53 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Using_jstack_or_jmap_or_other_… https://grafana.wikimedia.org/d/000000462/elasticsearch-memory?orgId=1&var-… Acknowledged by : Additional Info: (C)100 gt (W)80 gt 60

1 0

** PROBLEM alert - graphite1004/CirrusSearch eqiad 95th percentile latency is CRITICAL **
by nagios＠alert1001.wikimedia.org 29 Aug '21

29 Aug '21

Notification Type: PROBLEM Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: CRITICAL Date/Time: Sun Aug 29 02:59:53 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [1000.0]

1 0

** PROBLEM alert - graphite1004/CirrusSearch eqiad 95th percentile latency is CRITICAL **
by nagios＠alert1001.wikimedia.org 29 Aug '21

29 Aug '21

Notification Type: PROBLEM Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: CRITICAL Date/Time: Sun Aug 29 02:52:17 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [1000.0]

1 0

** PROBLEM alert - elastic2053/Rate of JVM GC Old generation-s runs - elastic2053-production-search-psi-codfw is CRITICAL **
by nagios＠alert1001.wikimedia.org 29 Aug '21

29 Aug '21

Notification Type: PROBLEM Service: Rate of JVM GC Old generation-s runs - elastic2053-production-search-psi-codfw Host: elastic2053 Address: 10.192.48.129 State: CRITICAL Date/Time: Sun Aug 29 02:46:33 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Using_jstack_or_jmap_or_other_… https://grafana.wikimedia.org/d/000000462/elasticsearch-memory?orgId=1&var-… Acknowledged by : Additional Info: 102.7 gt 100

1 0

** RECOVERY alert - graphite1004/CirrusSearch eqiad 95th percentile latency is OK **
by nagios＠alert1001.wikimedia.org 29 Aug '21

29 Aug '21

Notification Type: RECOVERY Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: OK Date/Time: Sun Aug 29 01:46:39 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Acknowledged by : Additional Info: OK: Less than 20.00% above the threshold [500.0]

1 0

← Newer
1
2
3
4
5
6
7
8
...
15
Older →

Jump to page: