- Discovery-alerts - lists.wikimedia.org

** PROBLEM alert - graphite1004/CirrusSearch eqiad 95th percentile latency is CRITICAL **

by nagios＠alert1001.wikimedia.org

Notification Type: PROBLEM Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: CRITICAL Date/Time: Sun May 23 19:02:15 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Acknowledged by : Additional Info: CRITICAL: 30.00% of data above the critical threshold [1000.0]

2 years, 11 months

1
0
0 0

** RECOVERY alert - cloudelastic1004/ElasticSearch health check for shards on 9400 is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9400 Host: cloudelastic1004 Address: 208.80.155.107 State: OK Date/Time: Thu May 20 06:05:36 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status cloudelastic-omega-eqiad: number_of_in_flight_fetch: 0, timed_out: False, active_primary_shards: 748, relocating_shards: 0, unassigned_shards: 0, active_shards_percent_as_number: 100.0, delayed_unassigned_shards: 0, active_shards: 1498, task_max_waiting_in_queue_millis: 0, initializing_shards: 0, status: green, number_of_data_nodes: 6, cluster_name: cloudelastic-omega-eqiad, number_of_pending_tasks: 0, number_of_nodes: 6

2 years, 11 months

1
0
0 0

** RECOVERY alert - cloudelastic1005/ElasticSearch health check for shards on 9600 is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9600 Host: cloudelastic1005 Address: 208.80.154.9 State: OK Date/Time: Thu May 20 06:05:14 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status cloudelastic-psi-eqiad: delayed_unassigned_shards: 0, active_shards_percent_as_number: 100.0, relocating_shards: 0, number_of_nodes: 6, active_primary_shards: 723, timed_out: False, number_of_data_nodes: 6, cluster_name: cloudelastic-psi-eqiad, task_max_waiting_in_queue_millis: 0, number_of_in_flight_fetch: 0, initializing_shards: 0, active_shards: 1448, unassigned_shards: 0, number_of_pending_tasks: 0, status: green

2 years, 11 months

1
0
0 0

** RECOVERY alert - cloudelastic1001/ElasticSearch health check for shards on 9600 is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9600 Host: cloudelastic1001 Address: 208.80.154.8 State: OK Date/Time: Thu May 20 06:05:14 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status cloudelastic-psi-eqiad: status: green, delayed_unassigned_shards: 0, initializing_shards: 0, active_shards: 1448, relocating_shards: 0, number_of_nodes: 6, active_primary_shards: 723, unassigned_shards: 0, cluster_name: cloudelastic-psi-eqiad, number_of_data_nodes: 6, task_max_waiting_in_queue_millis: 0, timed_out: False, number_of_in_flight_fetch: 0, active_shards_percent_as_number: 100.0, number_of_pending_tasks: 0

2 years, 11 months

1
0
0 0

** RECOVERY alert - cloudelastic1001/ElasticSearch health check for shards on 9400 is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9400 Host: cloudelastic1001 Address: 208.80.154.8 State: OK Date/Time: Thu May 20 06:04:42 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status cloudelastic-omega-eqiad: cluster_name: cloudelastic-omega-eqiad, status: green, active_primary_shards: 748, timed_out: False, number_of_nodes: 6, relocating_shards: 0, number_of_pending_tasks: 0, unassigned_shards: 0, task_max_waiting_in_queue_millis: 0, number_of_data_nodes: 6, active_shards_percent_as_number: 100.0, delayed_unassigned_shards: 0, active_shards: 1498, number_of_in_flight_fetch: 0, initializing_shards: 0

2 years, 11 months

1
0
0 0

** RECOVERY alert - cloudelastic1002/ElasticSearch health check for shards on 9400 is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9400 Host: cloudelastic1002 Address: 208.80.154.133 State: OK Date/Time: Thu May 20 06:04:42 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status cloudelastic-omega-eqiad: number_of_data_nodes: 6, active_primary_shards: 748, active_shards: 1498, relocating_shards: 0, number_of_nodes: 6, timed_out: False, initializing_shards: 0, number_of_in_flight_fetch: 0, task_max_waiting_in_queue_millis: 0, number_of_pending_tasks: 0, status: green, delayed_unassigned_shards: 0, unassigned_shards: 0, cluster_name: cloudelastic-omega-eqiad, active_shards_percent_as_number: 100.0

2 years, 11 months

1
0
0 0

** RECOVERY alert - cloudelastic1003/ElasticSearch health check for shards on 9200 is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9200 Host: cloudelastic1003 Address: 208.80.154.83 State: OK Date/Time: Thu May 20 06:04:42 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status cloudelastic-chi-eqiad: initializing_shards: 4, delayed_unassigned_shards: 0, number_of_pending_tasks: 6, unassigned_shards: 19, relocating_shards: 0, active_primary_shards: 759, number_of_nodes: 6, number_of_data_nodes: 6, task_max_waiting_in_queue_millis: 1501, cluster_name: cloudelastic-chi-eqiad, number_of_in_flight_fetch: 0, active_shards_percent_as_number: 98.4878369493754, active_shards: 1498, timed_out: False, status: yellow

2 years, 11 months

1
0
0 0

** RECOVERY alert - cloudelastic1002/ElasticSearch health check for shards on 9200 is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9200 Host: cloudelastic1002 Address: 208.80.154.133 State: OK Date/Time: Thu May 20 06:04:36 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status cloudelastic-chi-eqiad: status: yellow, cluster_name: cloudelastic-chi-eqiad, timed_out: False, number_of_data_nodes: 6, active_primary_shards: 759, number_of_in_flight_fetch: 0, active_shards: 1472, unassigned_shards: 45, active_shards_percent_as_number: 96.7784352399737, relocating_shards: 0, initializing_shards: 4, delayed_unassigned_shards: 0, number_of_nodes: 6, task_max_waiting_in_queue_millis: 205, number_of_pending_tasks: 2

2 years, 11 months

1
0
0 0

** RECOVERY alert - cloudelastic1001/ElasticSearch health check for shards on 9200 is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9200 Host: cloudelastic1001 Address: 208.80.154.8 State: OK Date/Time: Thu May 20 06:04:36 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status cloudelastic-chi-eqiad: number_of_in_flight_fetch: 0, unassigned_shards: 37, cluster_name: cloudelastic-chi-eqiad, delayed_unassigned_shards: 0, task_max_waiting_in_queue_millis: 250, timed_out: False, relocating_shards: 0, number_of_data_nodes: 6, number_of_pending_tasks: 3, active_shards: 1480, active_primary_shards: 759, active_shards_percent_as_number: 97.30440499671269, initializing_shards: 4, status: yellow, number_of_nodes: 6

2 years, 11 months

1
0
0 0

** RECOVERY alert - cloudelastic1002/ElasticSearch health check for shards on 9600 is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9600 Host: cloudelastic1002 Address: 208.80.154.133 State: OK Date/Time: Thu May 20 06:04:34 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status cloudelastic-psi-eqiad: active_shards_percent_as_number: 100.0, unassigned_shards: 0, number_of_data_nodes: 6, relocating_shards: 0, status: green, active_primary_shards: 723, delayed_unassigned_shards: 0, number_of_in_flight_fetch: 0, task_max_waiting_in_queue_millis: 0, cluster_name: cloudelastic-psi-eqiad, number_of_nodes: 6, active_shards: 1448, timed_out: False, number_of_pending_tasks: 0, initializing_shards: 0

2 years, 11 months

1
0
0 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

Discovery-alerts