April 2021 - Discovery-alerts - lists.wikimedia.org

** RECOVERY alert - cloudelastic1002/Rate of JVM GC Old generation-s runs - cloudelastic1002-cloudelastic-chi-eqiad is OK **
by nagios＠alert1001.wikimedia.org 19 Apr '21

19 Apr '21

Notification Type: RECOVERY Service: Rate of JVM GC Old generation-s runs - cloudelastic1002-cloudelastic-chi-eqiad Host: cloudelastic1002 Address: 208.80.154.133 State: OK Date/Time: Mon Apr 19 02:29:36 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Using_jstack_or_jmap_or_other_… https://grafana.wikimedia.org/d/000000462/elasticsearch-memory?orgId=1&var-… Acknowledged by : Additional Info: (C)100 gt (W)80 gt 77.29

1 0

** RECOVERY alert - cloudelastic1003/Rate of JVM GC Old generation-s runs - cloudelastic1003-cloudelastic-chi-eqiad is OK **
by nagios＠alert1001.wikimedia.org 19 Apr '21

19 Apr '21

Notification Type: RECOVERY Service: Rate of JVM GC Old generation-s runs - cloudelastic1003-cloudelastic-chi-eqiad Host: cloudelastic1003 Address: 208.80.154.83 State: OK Date/Time: Mon Apr 19 02:21:34 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Using_jstack_or_jmap_or_other_… https://grafana.wikimedia.org/d/000000462/elasticsearch-memory?orgId=1&var-… Acknowledged by : Additional Info: (C)100 gt (W)80 gt 71.19

1 0

[airflow] SLA miss on DAG=export_queries_to_relforge
by noreply＠wikimedia.org 19 Apr '21

19 Apr '21

1 0

** PROBLEM alert - cloudelastic1003/Rate of JVM GC Old generation-s runs - cloudelastic1003-cloudelastic-chi-eqiad is CRITICAL **
by nagios＠alert1001.wikimedia.org 19 Apr '21

19 Apr '21

Notification Type: PROBLEM Service: Rate of JVM GC Old generation-s runs - cloudelastic1003-cloudelastic-chi-eqiad Host: cloudelastic1003 Address: 208.80.154.83 State: CRITICAL Date/Time: Mon Apr 19 01:18:24 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Using_jstack_or_jmap_or_other_… https://grafana.wikimedia.org/d/000000462/elasticsearch-memory?orgId=1&var-… Acknowledged by : Additional Info: 139.3 gt 100

1 0

** RECOVERY alert - cloudelastic1006/ElasticSearch health check for shards on 9200 is OK **
by nagios＠alert1001.wikimedia.org 19 Apr '21

19 Apr '21

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9200 Host: cloudelastic1006 Address: 208.80.154.138 State: OK Date/Time: Mon Apr 19 01:17:52 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status cloudelastic-chi-eqiad: initializing_shards: 0, timed_out: False, status: green, task_max_waiting_in_queue_millis: 0, cluster_name: cloudelastic-chi-eqiad, active_primary_shards: 895, active_shards: 1793, relocating_shards: 0, number_of_in_flight_fetch: 0, number_of_pending_tasks: 0, number_of_nodes: 6, number_of_data_nodes: 6, active_shards_percent_as_number: 100.0, delayed_unassigned_shards: 0, unassigned_shards: 0

1 0

** PROBLEM alert - cloudelastic1006/ElasticSearch health check for shards on 9200 is CRITICAL **
by nagios＠alert1001.wikimedia.org 19 Apr '21

19 Apr '21

Notification Type: PROBLEM Service: ElasticSearch health check for shards on 9200 Host: cloudelastic1006 Address: 208.80.154.138 State: CRITICAL Date/Time: Mon Apr 19 01:15:40 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: CRITICAL - elasticsearch http://localhost:9200/_cluster/health error while fetching: HTTPConnectionPool(host=localhost, port=9200): Read timed out. (read timeout=4)

1 0

[airflow] SLA miss on DAG=export_queries_to_relforge
by noreply＠wikimedia.org 19 Apr '21

19 Apr '21

1 0

[airflow] SLA miss on DAG=export_queries_to_relforge
by noreply＠wikimedia.org 19 Apr '21

19 Apr '21

1 0

[airflow] SLA miss on DAG=export_queries_to_relforge
by noreply＠wikimedia.org 19 Apr '21

19 Apr '21

1 0

[airflow] SLA miss on DAG=export_queries_to_relforge
by noreply＠wikimedia.org 18 Apr '21

18 Apr '21

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

Discovery-alerts April 2021