Discovery-alerts January 2017

discovery-alerts@lists.wikimedia.org

1 participants
2 discussions

** RECOVERY alert - search.svc.codfw.wmnet/ElasticSearch health check for shards is OK **

by icinga＠einsteinium.wikimedia.org

Notification Type: RECOVERY Service: ElasticSearch health check for shards Host: search.svc.codfw.wmnet Address: 10.2.1.30 State: OK Date/Time: Fri Jan 6 11:29:31 UTC 2017 Additional Info: OK - elasticsearch status production-search-codfw: status: yellow, number_of_nodes: 24, unassigned_shards: 802, number_of_pending_tasks: 904, number_of_in_flight_fetch: 0, timed_out: False, active_primary_shards: 3027, task_max_waiting_in_queue_millis: 192913, cluster_name: production-search-codfw, relocating_shards: 0, active_shards_percent_as_number: 90.3521359974, active_shards: 8185, initializing_shards: 72, number_of_data_nodes: 24, delayed_unassigned_shards: 0

7 years, 3 months

** PROBLEM alert - search.svc.codfw.wmnet/ElasticSearch health check for shards is CRITICAL **

by icinga＠einsteinium.wikimedia.org

Notification Type: PROBLEM Service: ElasticSearch health check for shards Host: search.svc.codfw.wmnet Address: 10.2.1.30 State: CRITICAL Date/Time: Fri Jan 6 08:33:31 UTC 2017 Additional Info: CRITICAL - elasticsearch inactive shards 3744 threshold =0.1% breach: status: red, number_of_nodes: 24, unassigned_shards: 3648, number_of_pending_tasks: 3009, number_of_in_flight_fetch: 0, timed_out: False, active_primary_shards: 3018, task_max_waiting_in_queue_millis: 130284, cluster_name: production-search-codfw, relocating_shards: 0, active_shards_percent_as_number: 58.5657370518, active_shards: 5292, initializing_shards: 96, number_of_data_nodes: 24, delayed_unassigned_shards: 194

7 years, 3 months

2024

2023

2022

2021

2020

2019

2018

2017

2016

Discovery-alerts January 2017