2024

2023

2022

2021

2020

2019

2018

2017

2016

List overview
Download

Discovery-alerts August 2021

discovery-alerts@lists.wikimedia.org

3 participants
149 discussions

Start a nNew thread

** RECOVERY alert - elastic2059/Rate of JVM GC Old generation-s runs - elastic2059-production-search-omega-codfw is OK **
by nagios＠alert1001.wikimedia.org 22 Aug '21

22 Aug '21

Notification Type: RECOVERY Service: Rate of JVM GC Old generation-s runs - elastic2059-production-search-omega-codfw Host: elastic2059 Address: 10.192.32.5 State: OK Date/Time: Sun Aug 22 05:01:18 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Using_jstack_or_jmap_or_other_… https://grafana.wikimedia.org/d/000000462/elasticsearch-memory?orgId=1&var-… Acknowledged by : Additional Info: (C)100 gt (W)80 gt 53.9

1 0

** PROBLEM alert - elastic2053/Rate of JVM GC Old generation-s runs - elastic2053-production-search-psi-codfw is CRITICAL **
by nagios＠alert1001.wikimedia.org 22 Aug '21

22 Aug '21

Notification Type: PROBLEM Service: Rate of JVM GC Old generation-s runs - elastic2053-production-search-psi-codfw Host: elastic2053 Address: 10.192.48.129 State: CRITICAL Date/Time: Sun Aug 22 04:53:36 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Using_jstack_or_jmap_or_other_… https://grafana.wikimedia.org/d/000000462/elasticsearch-memory?orgId=1&var-… Acknowledged by : Additional Info: 143.4 gt 100

1 0

** PROBLEM alert - elastic2059/Rate of JVM GC Old generation-s runs - elastic2059-production-search-omega-codfw is CRITICAL **
by nagios＠alert1001.wikimedia.org 22 Aug '21

22 Aug '21

Notification Type: PROBLEM Service: Rate of JVM GC Old generation-s runs - elastic2059-production-search-omega-codfw Host: elastic2059 Address: 10.192.32.5 State: CRITICAL Date/Time: Sun Aug 22 04:43:48 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Using_jstack_or_jmap_or_other_… https://grafana.wikimedia.org/d/000000462/elasticsearch-memory?orgId=1&var-… Acknowledged by : Additional Info: 106.8 gt 100

1 0

** PROBLEM alert - elastic2056/Rate of JVM GC Old generation-s runs - elastic2056-production-search-omega-codfw is CRITICAL **
by nagios＠alert1001.wikimedia.org 22 Aug '21

22 Aug '21

Notification Type: PROBLEM Service: Rate of JVM GC Old generation-s runs - elastic2056-production-search-omega-codfw Host: elastic2056 Address: 10.192.0.181 State: CRITICAL Date/Time: Sun Aug 22 04:08:08 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Using_jstack_or_jmap_or_other_… https://grafana.wikimedia.org/d/000000462/elasticsearch-memory?orgId=1&var-… Acknowledged by : Additional Info: 476.9 gt 100

1 0

Airflow alert: <TaskInstance: search_satisfaction_daily.index_into_druid 2021-08-21T00:00:00+00:00 [failed]>
by noreply＠wikimedia.org 22 Aug '21

22 Aug '21

1 0

** RECOVERY alert - elastic2056/Rate of JVM GC Old generation-s runs - elastic2056-production-search-omega-codfw is OK **
by nagios＠alert1001.wikimedia.org 22 Aug '21

22 Aug '21

Notification Type: RECOVERY Service: Rate of JVM GC Old generation-s runs - elastic2056-production-search-omega-codfw Host: elastic2056 Address: 10.192.0.181 State: OK Date/Time: Sun Aug 22 03:44:50 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Using_jstack_or_jmap_or_other_… https://grafana.wikimedia.org/d/000000462/elasticsearch-memory?orgId=1&var-… Acknowledged by : Additional Info: (C)100 gt (W)80 gt 77.29

1 0

** RECOVERY alert - graphite1004/CirrusSearch eqiad 95th percentile latency is OK **
by nagios＠alert1001.wikimedia.org 22 Aug '21

22 Aug '21

Notification Type: RECOVERY Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: OK Date/Time: Sun Aug 22 03:30:02 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Acknowledged by : Additional Info: OK: Less than 20.00% above the threshold [500.0]

1 0

** PROBLEM alert - graphite1004/CirrusSearch eqiad 95th percentile latency is CRITICAL **
by nagios＠alert1001.wikimedia.org 22 Aug '21

22 Aug '21

Notification Type: PROBLEM Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: CRITICAL Date/Time: Sun Aug 22 03:22:16 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Acknowledged by : Additional Info: CRITICAL: 30.00% of data above the critical threshold [1000.0]

1 0

** RECOVERY alert - elastic2053/Rate of JVM GC Old generation-s runs - elastic2053-production-search-psi-codfw is OK **
by nagios＠alert1001.wikimedia.org 22 Aug '21

22 Aug '21

Notification Type: RECOVERY Service: Rate of JVM GC Old generation-s runs - elastic2053-production-search-psi-codfw Host: elastic2053 Address: 10.192.48.129 State: OK Date/Time: Sun Aug 22 03:20:16 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Using_jstack_or_jmap_or_other_… https://grafana.wikimedia.org/d/000000462/elasticsearch-memory?orgId=1&var-… Acknowledged by : Additional Info: (C)100 gt (W)80 gt 54.92

1 0

** PROBLEM alert - graphite1004/CirrusSearch eqiad 95th percentile latency is CRITICAL **
by nagios＠alert1001.wikimedia.org 22 Aug '21

22 Aug '21

Notification Type: PROBLEM Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: CRITICAL Date/Time: Sun Aug 22 02:55:04 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [1000.0]

1 0

← Newer
1
...
7
8
9
10
11
12
13
14
15
Older →

Jump to page: