Notification Type: PROBLEM

Service: ElasticSearch health check for shards on 9243 Host: search.svc.eqiad.wmnet Address: 10.2.2.30 State: CRITICAL

Date/Time: Tue Apr 19 09:16:10 UTC 2022

Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration

Acknowledged by :

Additional Info:

CRITICAL - elasticsearch inactive shards 1236 threshold =0.2 breach: cluster_name: production-search-eqiad, status: red, timed_out: False, number_of_nodes: 36, number_of_data_nodes: 36, active_primary_shards: 1347, active_shards: 2886, relocating_shards: 0, initializing_shards: 72, unassigned_shards: 1164, delayed_unassigned_shards: 0, number_of_pending_tasks: 1628, number_of_in_flight_fetch: 36, task_max_waiting_in_queue_millis: 247056, active_shards_percent_as_number: 70.01455604075691