2024

2023

2022

2021

2020

2019

2018

2017

2016

List overview
Download

Discovery-alerts March 2021

discovery-alerts@lists.wikimedia.org

3 participants
64 discussions

Start a nNew thread

Airflow alert: <TaskInstance: transfer_to_es_hourly.wait_for_ores_predictions 2021-03-23T09:00:00+00:00 [up_for_retry]>
by noreply＠wikimedia.org 23 Mar '21

23 Mar '21

1 0

** RECOVERY alert - graphite1004/CirrusSearch eqiad 95th percentile latency is OK **
by nagios＠alert1001.wikimedia.org 23 Mar '21

23 Mar '21

Notification Type: RECOVERY Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: OK Date/Time: Tue Mar 23 17:59:38 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Acknowledged by : Additional Info: OK: Less than 20.00% above the threshold [500.0]

1 0

** PROBLEM alert - graphite1004/CirrusSearch eqiad 95th percentile latency is CRITICAL **
by nagios＠alert1001.wikimedia.org 23 Mar '21

23 Mar '21

Notification Type: PROBLEM Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: CRITICAL Date/Time: Tue Mar 23 17:43:48 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Acknowledged by : Additional Info: CRITICAL: 30.00% of data above the critical threshold [1000.0]

1 0

Airflow alert: <TaskInstance: transfer_to_es_hourly.wait_for_ores_predictions 2021-03-23T09:00:00+00:00 [up_for_retry]>
by noreply＠wikimedia.org 23 Mar '21

23 Mar '21

1 0

Airflow alert: <TaskInstance: ores_predictions_hourly.wait_for_hourly_data 2021-03-23T10:00:00+00:00 [up_for_retry]>
by noreply＠wikimedia.org 23 Mar '21

23 Mar '21

1 0

Airflow alert: <TaskInstance: ores_predictions_hourly.wait_for_hourly_data 2021-03-23T09:00:00+00:00 [up_for_retry]>
by noreply＠wikimedia.org 23 Mar '21

23 Mar '21

1 0

Airflow alert: <TaskInstance: transfer_to_es_hourly.wait_for_ores_predictions 2021-03-23T09:00:00+00:00 [up_for_retry]>
by noreply＠wikimedia.org 23 Mar '21

23 Mar '21

1 0

** RECOVERY alert - cloudelastic1005/Rate of JVM GC Old generation-s runs - cloudelastic1005-cloudelastic-chi-eqiad is OK **
by nagios＠alert1001.wikimedia.org 23 Mar '21

23 Mar '21

Notification Type: RECOVERY Service: Rate of JVM GC Old generation-s runs - cloudelastic1005-cloudelastic-chi-eqiad Host: cloudelastic1005 Address: 208.80.154.9 State: OK Date/Time: Tue Mar 23 10:15:41 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Using_jstack_or_jmap_or_other_… https://grafana.wikimedia.org/d/000000462/elasticsearch-memory?orgId=1&var-… Acknowledged by : Additional Info: (C)100 gt (W)80 gt 65.08

1 0

** PROBLEM alert - cloudelastic1005/Rate of JVM GC Old generation-s runs - cloudelastic1005-cloudelastic-chi-eqiad is CRITICAL **
by nagios＠alert1001.wikimedia.org 23 Mar '21

23 Mar '21

Notification Type: PROBLEM Service: Rate of JVM GC Old generation-s runs - cloudelastic1005-cloudelastic-chi-eqiad Host: cloudelastic1005 Address: 208.80.154.9 State: CRITICAL Date/Time: Tue Mar 23 08:37:02 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Using_jstack_or_jmap_or_other_… https://grafana.wikimedia.org/d/000000462/elasticsearch-memory?orgId=1&var-… Acknowledged by : Additional Info: 114.9 gt 100

1 0

** RECOVERY alert - graphite1004/CirrusSearch eqiad 95th percentile latency is OK **
by nagios＠alert1001.wikimedia.org 22 Mar '21

22 Mar '21

Notification Type: RECOVERY Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: OK Date/Time: Mon Mar 22 20:23:45 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Acknowledged by : Additional Info: OK: Less than 20.00% above the threshold [500.0]

1 0