Notification Type: PROBLEM
Service: ElasticSearch health check for shards
Host: search.svc.codfw.wmnet
Address: 10.2.1.30
State: CRITICAL
Date/Time: Thu Jun 29 09:04:04 UTC 2017
Additional Info:
CRITICAL - elasticsearch inactive shards 2198 threshold =0.1 breach: status: red, number_of_nodes: 27, unassigned_shards: 2094, number_of_pending_tasks: 2364, number_of_in_flight_fetch: 0, timed_out: False, active_primary_shards: 3077, task_max_waiting_in_queue_millis: 674059, cluster_name: production-search-codfw, relocating_shards: 0, active_shards_percent_as_number: 76.1966645008, active_shards: 7036, initializing_shards: 104, number_of_data_nodes: 27, delayed_unassigned_shards: 0