- Discovery-alerts - lists.wikimedia.org

[FIRING:4] ProbeDown search-platform (probes/custom ops info prometheus)
by sre-observability＠wikimedia.org 28 Feb '24

28 Feb '24

1 0

[FIRING:2] ProbeDown search-platform (wdqs2007:443 probes/custom ops info codfw prometheus)
by sre-observability＠wikimedia.org 28 Feb '24

28 Feb '24

1 0

** RECOVERY alert - cloudelastic1010/ElasticSearch health check for shards on 9400 is OK **
by nagios＠alert1001.wikimedia.org 27 Feb '24

27 Feb '24

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9400 Host: cloudelastic1010 Address: 10.64.48.24 State: OK Date/Time: Mon Feb 26 22:19:32 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status cloudelastic-omega-eqiad: cluster_name: cloudelastic-omega-eqiad, status: yellow, timed_out: False, number_of_nodes: 6, number_of_data_nodes: 6, active_primary_shards: 799, active_shards: 1447, relocating_shards: 0, initializing_shards: 7, unassigned_shards: 146, delayed_unassigned_shards: 0, number_of_pending_tasks: 9, number_of_in_flight_fetch: 0, task_max_waiting_in_queue_millis: 1027, active_shards_percent_as_number: 90.4375

1 0

** RECOVERY alert - cloudelastic1006/ElasticSearch health check for shards on 9400 is OK **
by nagios＠alert1001.wikimedia.org 27 Feb '24

27 Feb '24

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9400 Host: cloudelastic1006 Address: 10.64.16.22 State: OK Date/Time: Mon Feb 26 22:19:32 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status cloudelastic-omega-eqiad: cluster_name: cloudelastic-omega-eqiad, status: yellow, timed_out: False, number_of_nodes: 6, number_of_data_nodes: 6, active_primary_shards: 799, active_shards: 1451, relocating_shards: 0, initializing_shards: 3, unassigned_shards: 146, delayed_unassigned_shards: 0, number_of_pending_tasks: 3, number_of_in_flight_fetch: 0, task_max_waiting_in_queue_millis: 1418, active_shards_percent_as_number: 90.6875

1 0

** RECOVERY alert - cloudelastic1006/ElasticSearch health check for shards on 9200 is OK **
by nagios＠alert1001.wikimedia.org 27 Feb '24

27 Feb '24

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9200 Host: cloudelastic1006 Address: 10.64.16.22 State: OK Date/Time: Mon Feb 26 22:19:32 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status cloudelastic-chi-eqiad: cluster_name: cloudelastic-chi-eqiad, status: yellow, timed_out: False, number_of_nodes: 6, number_of_data_nodes: 6, active_primary_shards: 764, active_shards: 1340, relocating_shards: 0, initializing_shards: 32, unassigned_shards: 159, delayed_unassigned_shards: 0, number_of_pending_tasks: 0, number_of_in_flight_fetch: 0, task_max_waiting_in_queue_millis: 0, active_shards_percent_as_number: 87.52449379490528

1 0

** RECOVERY alert - cloudelastic1008/ElasticSearch health check for shards on 9200 is OK **
by nagios＠alert1001.wikimedia.org 27 Feb '24

27 Feb '24

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9200 Host: cloudelastic1008 Address: 10.64.16.10 State: OK Date/Time: Mon Feb 26 22:19:30 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status cloudelastic-chi-eqiad: cluster_name: cloudelastic-chi-eqiad, status: yellow, timed_out: False, number_of_nodes: 6, number_of_data_nodes: 6, active_primary_shards: 764, active_shards: 1339, relocating_shards: 0, initializing_shards: 32, unassigned_shards: 160, delayed_unassigned_shards: 0, number_of_pending_tasks: 0, number_of_in_flight_fetch: 0, task_max_waiting_in_queue_millis: 0, active_shards_percent_as_number: 87.45917700849118

1 0

** RECOVERY alert - cloudelastic1008/ElasticSearch health check for shards on 9400 is OK **
by nagios＠alert1001.wikimedia.org 27 Feb '24

27 Feb '24

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9400 Host: cloudelastic1008 Address: 10.64.16.10 State: OK Date/Time: Mon Feb 26 22:19:30 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status cloudelastic-omega-eqiad: cluster_name: cloudelastic-omega-eqiad, status: yellow, timed_out: False, number_of_nodes: 6, number_of_data_nodes: 6, active_primary_shards: 799, active_shards: 1444, relocating_shards: 0, initializing_shards: 2, unassigned_shards: 154, delayed_unassigned_shards: 0, number_of_pending_tasks: 2, number_of_in_flight_fetch: 0, task_max_waiting_in_queue_millis: 4338, active_shards_percent_as_number: 90.25

1 0

** RECOVERY alert - cloudelastic1010/ElasticSearch health check for shards on 9200 is OK **
by nagios＠alert1001.wikimedia.org 27 Feb '24

27 Feb '24

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9200 Host: cloudelastic1010 Address: 10.64.48.24 State: OK Date/Time: Mon Feb 26 22:19:30 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status cloudelastic-chi-eqiad: cluster_name: cloudelastic-chi-eqiad, status: yellow, timed_out: False, number_of_nodes: 6, number_of_data_nodes: 6, active_primary_shards: 764, active_shards: 1340, relocating_shards: 0, initializing_shards: 32, unassigned_shards: 159, delayed_unassigned_shards: 0, number_of_pending_tasks: 0, number_of_in_flight_fetch: 0, task_max_waiting_in_queue_millis: 0, active_shards_percent_as_number: 87.52449379490528

1 0

** RECOVERY alert - cloudelastic1009/ElasticSearch health check for shards on 9200 is OK **
by nagios＠alert1001.wikimedia.org 27 Feb '24

27 Feb '24

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9200 Host: cloudelastic1009 Address: 10.64.32.30 State: OK Date/Time: Mon Feb 26 22:19:22 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status cloudelastic-chi-eqiad: cluster_name: cloudelastic-chi-eqiad, status: yellow, timed_out: False, number_of_nodes: 6, number_of_data_nodes: 6, active_primary_shards: 764, active_shards: 1339, relocating_shards: 0, initializing_shards: 32, unassigned_shards: 160, delayed_unassigned_shards: 0, number_of_pending_tasks: 0, number_of_in_flight_fetch: 0, task_max_waiting_in_queue_millis: 0, active_shards_percent_as_number: 87.45917700849118

1 0

** RECOVERY alert - cloudelastic1009/ElasticSearch health check for shards on 9400 is OK **
by nagios＠alert1001.wikimedia.org 27 Feb '24

27 Feb '24

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9400 Host: cloudelastic1009 Address: 10.64.32.30 State: OK Date/Time: Mon Feb 26 22:19:22 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status cloudelastic-omega-eqiad: cluster_name: cloudelastic-omega-eqiad, status: yellow, timed_out: False, number_of_nodes: 6, number_of_data_nodes: 6, active_primary_shards: 799, active_shards: 1430, relocating_shards: 0, initializing_shards: 5, unassigned_shards: 165, delayed_unassigned_shards: 0, number_of_pending_tasks: 8, number_of_in_flight_fetch: 0, task_max_waiting_in_queue_millis: 679, active_shards_percent_as_number: 89.375

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

Discovery-alerts