Notification Type: PROBLEM

Service: OpenSearch health check for shards on 9200 Host: logging-hd1002 Address: 10.64.16.76 State: CRITICAL

Date/Time: Sat Jun 22 22:28:33 UTC 2024

Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration

Acknowledged by :

Additional Info:

CRITICAL - elasticsearch inactive shards 635 threshold =0.34 breach: cluster_name: production-elk7-eqiad, status: red, timed_out: False, number_of_nodes: 17, number_of_data_nodes: 11, discovered_master: True, discovered_cluster_manager: True, active_primary_shards: 731, active_shards: 1093, relocating_shards: 0, initializing_shards: 12, unassigned_shards: 623, delayed_unassigned_shards: 0, number_of_pending_tasks: 8, number_of_in_flight_fetch: 0, task_max_waiting_in_queue_millis: 2534, active_shards_percent_as_number: 63.25231481481482