Notification Type: PROBLEM
Service: ElasticSearch health check for shards on 9443 Host: search.svc.codfw.wmnet Address: 10.2.1.30 State: CRITICAL
Date/Time: Thu Jul 18 11:50:58 UTC 2024
Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration
Acknowledged by :
Additional Info:
CRITICAL - elasticsearch inactive shards 1305 threshold =0.2 breach: cluster_name: production-search-omega-codfw, status: red, timed_out: False, number_of_nodes: 13, number_of_data_nodes: 13, active_primary_shards: 1655, active_shards: 3662, relocating_shards: 0, initializing_shards: 22, unassigned_shards: 1283, delayed_unassigned_shards: 0, number_of_pending_tasks: 21, number_of_in_flight_fetch: 0, task_max_waiting_in_queue_millis: 37695, active_shards_percent_as_number: 73.7265955305013
discovery-alerts@lists.wikimedia.org