Discovery-alerts November 2020

discovery-alerts@lists.wikimedia.org

4 participants
177 discussions

** RECOVERY alert - logstash1009/ElasticSearch health check for shards on 9200 is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9200 Host: logstash1009 Address: 10.64.32.27 State: OK Date/Time: Tue Nov 3 02:13:19 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status production-logstash-eqiad: active_shards: 916, unassigned_shards: 0, number_of_nodes: 6, number_of_pending_tasks: 0, delayed_unassigned_shards: 0, active_shards_percent_as_number: 100.0, active_primary_shards: 483, task_max_waiting_in_queue_millis: 0, timed_out: False, initializing_shards: 0, number_of_in_flight_fetch: 0, number_of_data_nodes: 3, cluster_name: production-logstash-eqiad, status: green, relocating_shards: 0

3 years, 5 months

** PROBLEM alert - logstash1009/ElasticSearch health check for shards on 9200 is CRITICAL **

by nagios＠alert1001.wikimedia.org

Notification Type: PROBLEM Service: ElasticSearch health check for shards on 9200 Host: logstash1009 Address: 10.64.32.27 State: CRITICAL Date/Time: Tue Nov 3 01:56:31 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: CRITICAL - elasticsearch http://localhost:9200/_cluster/health error while fetching: HTTPConnectionPool(host=localhost, port=9200): Max retries exceeded with url: /_cluster/health (Caused by NewConnectionError(requests.packages.urllib3.connection.HTTPConnection object at 0x7f7e22c024e0: Failed to establish a new connection: [Errno 111] Connection refused,))

3 years, 5 months