April 2021 - Discovery-alerts - lists.wikimedia.org

** RECOVERY alert - alert1001/Mediawiki CirrusSearch update rate - codfw is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: Mediawiki CirrusSearch update rate - codfw Host: alert1001 Address: 208.80.154.88 State: OK Date/Time: Fri Apr 30 05:10:34 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23No_updates https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Acknowledged by : Additional Info: OK: Less than 1.00% under the threshold [80.0]

2 years, 11 months

1
0
0 0

** PROBLEM alert - alert1001/Mediawiki CirrusSearch update rate - codfw is CRITICAL **

by nagios＠alert1001.wikimedia.org

Notification Type: PROBLEM Service: Mediawiki CirrusSearch update rate - codfw Host: alert1001 Address: 208.80.154.88 State: CRITICAL Date/Time: Fri Apr 30 04:24:20 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23No_updates https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Acknowledged by : Additional Info: CRITICAL: 10.00% of data under the critical threshold [50.0]

2 years, 11 months

1
0
0 0

** RECOVERY alert - search.svc.codfw.wmnet/ElasticSearch numbers of masters eligible - 9443 is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: ElasticSearch numbers of masters eligible - 9443 Host: search.svc.codfw.wmnet Address: 10.2.1.30 State: OK Date/Time: Tue Apr 27 19:04:11 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Expected_eligible_masters_chec… Acknowledged by : Additional Info: OK - All good

2 years, 11 months

1
0
0 0

** PROBLEM alert - search.svc.codfw.wmnet/ElasticSearch numbers of masters eligible - 9443 is CRITICAL **

by nagios＠alert1001.wikimedia.org

Notification Type: PROBLEM Service: ElasticSearch numbers of masters eligible - 9443 Host: search.svc.codfw.wmnet Address: 10.2.1.30 State: CRITICAL Date/Time: Tue Apr 27 18:48:16 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Expected_eligible_masters_chec… Acknowledged by : Additional Info: CRITICAL - Found 2 eligible masters.

2 years, 11 months

1
0
0 0

** PROBLEM alert - search.svc.codfw.wmnet/ElasticSearch numbers of masters eligible - 9443 is CRITICAL **

by nagios＠alert1001.wikimedia.org

Notification Type: PROBLEM Service: ElasticSearch numbers of masters eligible - 9443 Host: search.svc.codfw.wmnet Address: 10.2.1.30 State: CRITICAL Date/Time: Tue Apr 27 15:56:20 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Expected_eligible_masters_chec… Acknowledged by : Additional Info: CRITICAL - Found 2 eligible masters.

2 years, 11 months

1
0
0 0

** RECOVERY alert - relforge1003/ElasticSearch health check for shards on 9200 is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9200 Host: relforge1003 Address: 10.64.5.37 State: OK Date/Time: Tue Apr 27 09:59:44 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status relforge-eqiad: active_shards_percent_as_number: 88.16705336426914, number_of_nodes: 2, active_shards: 4560, task_max_waiting_in_queue_millis: 0, cluster_name: relforge-eqiad, delayed_unassigned_shards: 0, number_of_data_nodes: 2, number_of_pending_tasks: 0, initializing_shards: 2, status: yellow, relocating_shards: 0, unassigned_shards: 610, timed_out: False, number_of_in_flight_fetch: 0, active_primary_shards: 2586

2 years, 11 months

1
0
0 0

** RECOVERY alert - relforge1004/ElasticSearch health check for shards on 9200 is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9200 Host: relforge1004 Address: 10.64.21.126 State: OK Date/Time: Tue Apr 27 09:58:54 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - elasticsearch status relforge-eqiad: cluster_name: relforge-eqiad, status: yellow, delayed_unassigned_shards: 0, timed_out: False, relocating_shards: 0, number_of_pending_tasks: 0, unassigned_shards: 753, initializing_shards: 2, number_of_nodes: 2, active_shards_percent_as_number: 85.40216550657385, number_of_in_flight_fetch: 0, task_max_waiting_in_queue_millis: 0, number_of_data_nodes: 2, active_primary_shards: 2586, active_shards: 4417

2 years, 11 months

1
0
0 0

** PROBLEM alert - relforge1004/ElasticSearch health check for shards on 9200 is CRITICAL **

by nagios＠alert1001.wikimedia.org

Notification Type: PROBLEM Service: ElasticSearch health check for shards on 9200 Host: relforge1004 Address: 10.64.21.126 State: CRITICAL Date/Time: Tue Apr 27 09:52:58 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: CRITICAL - elasticsearch inactive shards 1813 threshold =0.15 breach: unassigned_shards: 1811, number_of_in_flight_fetch: 0, initializing_shards: 2, relocating_shards: 0, number_of_pending_tasks: 0, active_primary_shards: 2586, active_shards_percent_as_number: 64.94586233565352, timed_out: False, delayed_unassigned_shards: 0, task_max_waiting_in_queue_millis: 0, active_shards: 3359, cluster_name: relforge-eqiad, status: yellow, number_of_nodes: 2, number_of_data_nodes: 2

2 years, 11 months

1
0
0 0

** PROBLEM alert - relforge1003/ElasticSearch health check for shards on 9200 is CRITICAL **

by nagios＠alert1001.wikimedia.org

Notification Type: PROBLEM Service: ElasticSearch health check for shards on 9200 Host: relforge1003 Address: 10.64.5.37 State: CRITICAL Date/Time: Tue Apr 27 09:52:32 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: CRITICAL - elasticsearch inactive shards 1889 threshold =0.15 breach: active_shards_percent_as_number: 63.47641144624904, initializing_shards: 2, number_of_nodes: 2, status: yellow, cluster_name: relforge-eqiad, delayed_unassigned_shards: 0, number_of_in_flight_fetch: 0, relocating_shards: 0, active_shards: 3283, active_primary_shards: 2586, task_max_waiting_in_queue_millis: 0, timed_out: False, number_of_data_nodes: 2, number_of_pending_tasks: 0, unassigned_shards: 1887

2 years, 11 months

1
0
0 0

Update on build jenkins-wikidata-query-rdf-maven-release-docker-49

by jenkins-bot

The build 49 for wikidata/query/rdf has finished. See https://integration.wikimedia.org/ci/job/wikidata-query-rdf-maven-release-d… for details.

2 years, 11 months

1
3
0 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

Discovery-alerts April 2021