Notification Type: PROBLEM
Service: ElasticSearch health check for shards on 9643
Host: search.svc.codfw.wmnet
Address: 10.2.1.30
State: CRITICAL
Date/Time: Wed Mar 27 20:09:40 UTC 2019
Notes URLs:
https://wikitech.wikimedia.org/wiki/Search%23Administration
Additional Info:
CRITICAL - elasticsearch inactive shards 626 threshold =0.15 breach:
active_shards_percent_as_number: 80.75030750307504, number_of_data_nodes: 15,
cluster_name: production-search-psi-codfw, number_of_pending_tasks: 1,
task_max_waiting_in_queue_millis: 0, active_shards: 2626, number_of_in_flight_fetch: 0,
initializing_shards: 46, unassigned_shards: 580, active_primary_shards: 1084,
number_of_nodes: 15, relocating_shards: 0, delayed_unassigned_shards: 0, status: yellow,
timed_out: False