Notification Type: PROBLEM
Service: ElasticSearch health check for shards on 9200
Host: logstash1009
Address: 10.64.32.27
State: CRITICAL
Date/Time: Thu Feb 27 21:42:38 UTC 2020
Notes URLs:
https://wikitech.wikimedia.org/wiki/Search%23Administration
Acknowledged by :
Additional Info:
CRITICAL - elasticsearch inactive shards 947 threshold =0.34 breach: unassigned_shards:
939, timed_out: False, active_shards_percent_as_number: 15.747330960854091,
task_max_waiting_in_queue_millis: 141613, relocating_shards: 0, delayed_unassigned_shards:
0, cluster_name: production-logstash-eqiad, status: red, number_of_pending_tasks: 111,
number_of_nodes: 5, active_primary_shards: 164, number_of_in_flight_fetch: 0,
active_shards: 177, initializing_shards: 8, number_of_data_nodes: 2