February 2020 - Discovery-alerts - lists.wikimedia.org

** RECOVERY alert - logstash1009/ElasticSearch health check for shards on 9200 is OK **
by nagios＠icinga1001.wikimedia.org 27 Feb '20

27 Feb '20

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9200 Host: logstash1009 Address: 10.64.32.27 State: OK Date/Time: Thu Feb 27 21:36:00 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status production-logstash-eqiad: task_max_waiting_in_queue_millis: 112780, number_of_data_nodes: 3, delayed_unassigned_shards: 0, number_of_in_flight_fetch: 1122, number_of_pending_tasks: 33, status: yellow, active_primary_shards: 484, active_shards_percent_as_number: 66.72597864768683, initializing_shards: 0, timed_out: False, relocating_shards: 0, active_shards: 750, cluster_name: production-logstash-eqiad, unassigned_shards: 374, number_of_nodes: 6

1 0

** RECOVERY alert - logstash1007/ElasticSearch health check for shards on 9200 is OK **
by nagios＠icinga1001.wikimedia.org 27 Feb '20

27 Feb '20

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9200 Host: logstash1007 Address: 10.64.0.37 State: OK Date/Time: Thu Feb 27 21:35:54 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status production-logstash-eqiad: timed_out: False, initializing_shards: 0, relocating_shards: 0, unassigned_shards: 374, active_shards_percent_as_number: 66.72597864768683, cluster_name: production-logstash-eqiad, task_max_waiting_in_queue_millis: 105976, active_primary_shards: 484, delayed_unassigned_shards: 0, status: yellow, number_of_nodes: 6, number_of_pending_tasks: 33, number_of_data_nodes: 3, number_of_in_flight_fetch: 1122, active_shards: 750

1 0

** RECOVERY alert - logstash1008/ElasticSearch health check for shards on 9200 is OK **
by nagios＠icinga1001.wikimedia.org 27 Feb '20

27 Feb '20

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9200 Host: logstash1008 Address: 10.64.0.90 State: OK Date/Time: Thu Feb 27 21:35:34 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status production-logstash-eqiad: number_of_nodes: 6, initializing_shards: 0, number_of_pending_tasks: 36, timed_out: False, number_of_data_nodes: 3, active_primary_shards: 484, active_shards: 750, status: yellow, cluster_name: production-logstash-eqiad, relocating_shards: 0, number_of_in_flight_fetch: 1122, active_shards_percent_as_number: 66.72597864768683, delayed_unassigned_shards: 0, task_max_waiting_in_queue_millis: 85255, unassigned_shards: 374

1 0

** RECOVERY alert - logstash1011/ElasticSearch health check for shards on 9200 is OK **
by nagios＠icinga1001.wikimedia.org 27 Feb '20

27 Feb '20

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9200 Host: logstash1011 Address: 10.64.16.30 State: OK Date/Time: Thu Feb 27 21:35:06 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status production-logstash-eqiad: initializing_shards: 0, timed_out: False, task_max_waiting_in_queue_millis: 56570, number_of_in_flight_fetch: 1122, active_primary_shards: 484, active_shards: 750, active_shards_percent_as_number: 66.72597864768683, delayed_unassigned_shards: 0, number_of_nodes: 6, cluster_name: production-logstash-eqiad, number_of_pending_tasks: 36, number_of_data_nodes: 3, unassigned_shards: 374, status: yellow, relocating_shards: 0

1 0

** RECOVERY alert - logstash1012/ElasticSearch health check for shards on 9200 is OK **
by nagios＠icinga1001.wikimedia.org 27 Feb '20

27 Feb '20

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9200 Host: logstash1012 Address: 10.64.48.177 State: OK Date/Time: Thu Feb 27 21:35:04 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status production-logstash-eqiad: relocating_shards: 0, unassigned_shards: 374, number_of_nodes: 6, cluster_name: production-logstash-eqiad, number_of_data_nodes: 3, active_shards: 750, task_max_waiting_in_queue_millis: 59399, active_shards_percent_as_number: 66.72597864768683, initializing_shards: 0, timed_out: False, status: yellow, number_of_in_flight_fetch: 1122, number_of_pending_tasks: 52, delayed_unassigned_shards: 0, active_primary_shards: 484

1 0

** PROBLEM alert - logstash1008/ElasticSearch health check for shards on 9200 is CRITICAL **
by nagios＠icinga1001.wikimedia.org 27 Feb '20

27 Feb '20

Notification Type: PROBLEM Service: ElasticSearch health check for shards on 9200 Host: logstash1008 Address: 10.64.0.90 State: CRITICAL Date/Time: Thu Feb 27 21:33:28 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: CRITICAL - elasticsearch http://localhost:9200/_cluster/health error while fetching: HTTPConnectionPool(host=localhost, port=9200): Read timed out. (read timeout=4)

1 0

** PROBLEM alert - logstash1012/ElasticSearch health check for shards on 9200 is CRITICAL **
by nagios＠icinga1001.wikimedia.org 27 Feb '20

27 Feb '20

Notification Type: PROBLEM Service: ElasticSearch health check for shards on 9200 Host: logstash1012 Address: 10.64.48.177 State: CRITICAL Date/Time: Thu Feb 27 21:32:58 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: CRITICAL - elasticsearch http://localhost:9200/_cluster/health error while fetching: HTTPConnectionPool(host=localhost, port=9200): Read timed out. (read timeout=4)

1 0

** PROBLEM alert - logstash1010/ElasticSearch health check for shards on 9200 is CRITICAL **
by nagios＠icinga1001.wikimedia.org 27 Feb '20

27 Feb '20

Notification Type: PROBLEM Service: ElasticSearch health check for shards on 9200 Host: logstash1010 Address: 10.64.0.181 State: CRITICAL Date/Time: Thu Feb 27 21:31:48 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: CRITICAL - elasticsearch http://localhost:9200/_cluster/health error while fetching: HTTPConnectionPool(host=localhost, port=9200): Read timed out. (read timeout=4)

1 0

** PROBLEM alert - logstash1009/ElasticSearch health check for shards on 9200 is CRITICAL **
by nagios＠icinga1001.wikimedia.org 27 Feb '20

27 Feb '20

Notification Type: PROBLEM Service: ElasticSearch health check for shards on 9200 Host: logstash1009 Address: 10.64.32.27 State: CRITICAL Date/Time: Thu Feb 27 21:31:46 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: CRITICAL - elasticsearch http://localhost:9200/_cluster/health error while fetching: HTTPConnectionPool(host=localhost, port=9200): Read timed out. (read timeout=4)

1 0

** PROBLEM alert - logstash1007/ElasticSearch health check for shards on 9200 is CRITICAL **
by nagios＠icinga1001.wikimedia.org 27 Feb '20

27 Feb '20

Notification Type: PROBLEM Service: ElasticSearch health check for shards on 9200 Host: logstash1007 Address: 10.64.0.37 State: CRITICAL Date/Time: Thu Feb 27 21:31:38 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: CRITICAL - elasticsearch http://localhost:9200/_cluster/health error while fetching: HTTPConnectionPool(host=localhost, port=9200): Read timed out. (read timeout=4)

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

Discovery-alerts February 2020