May 2019 - Discovery-alerts - lists.wikimedia.org

** PROBLEM alert - icinga1001/Mediawiki Cirrussearch update rate - codfw is CRITICAL **
by nagios＠icinga1001.wikimedia.org 05 May '19

05 May '19

Notification Type: PROBLEM Service: Mediawiki Cirrussearch update rate - codfw Host: icinga1001 Address: 208.80.154.84 State: CRITICAL Date/Time: Sun May 5 01:52:33 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: CRITICAL: 10.00% of data under the critical threshold [50.0]

1 0

** RECOVERY alert - icinga1001/Mediawiki Cirrussearch update rate - eqiad is OK **
by nagios＠icinga1001.wikimedia.org 04 May '19

04 May '19

Notification Type: RECOVERY Service: Mediawiki Cirrussearch update rate - eqiad Host: icinga1001 Address: 208.80.154.84 State: OK Date/Time: Sat May 4 15:25:11 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: OK: Less than 1.00% under the threshold [80.0]

1 0

** RECOVERY alert - icinga1001/Mediawiki Cirrussearch update rate - codfw is OK **
by nagios＠icinga1001.wikimedia.org 04 May '19

04 May '19

Notification Type: RECOVERY Service: Mediawiki Cirrussearch update rate - codfw Host: icinga1001 Address: 208.80.154.84 State: OK Date/Time: Sat May 4 15:24:35 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: OK: Less than 1.00% under the threshold [80.0]

1 0

** PROBLEM alert - icinga1001/Mediawiki Cirrussearch update rate - eqiad is CRITICAL **
by nagios＠icinga1001.wikimedia.org 04 May '19

04 May '19

Notification Type: PROBLEM Service: Mediawiki Cirrussearch update rate - eqiad Host: icinga1001 Address: 208.80.154.84 State: CRITICAL Date/Time: Sat May 4 15:12:01 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: CRITICAL: 20.00% of data under the critical threshold [50.0]

1 0

** PROBLEM alert - icinga1001/Mediawiki Cirrussearch update rate - codfw is CRITICAL **
by nagios＠icinga1001.wikimedia.org 04 May '19

04 May '19

Notification Type: PROBLEM Service: Mediawiki Cirrussearch update rate - codfw Host: icinga1001 Address: 208.80.154.84 State: CRITICAL Date/Time: Sat May 4 15:11:25 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: CRITICAL: 20.00% of data under the critical threshold [50.0]

1 0

** RECOVERY alert - search.svc.codfw.wmnet/ElasticSearch health check for shards on 9443 is OK **
by nagios＠icinga1001.wikimedia.org 03 May '19

03 May '19

Notification Type: RECOVERY Service: ElasticSearch health check for shards on 9443 Host: search.svc.codfw.wmnet Address: 10.2.1.30 State: OK Date/Time: Fri May 3 00:33:02 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Additional Info: OK - elasticsearch status production-search-omega-codfw: cluster_name: production-search-omega-codfw, number_of_nodes: 14, active_shards: 3158, unassigned_shards: 225, active_primary_shards: 1128, initializing_shards: 0, delayed_unassigned_shards: 225, status: yellow, number_of_data_nodes: 14, number_of_pending_tasks: 0, relocating_shards: 0, number_of_in_flight_fetch: 0, active_shards_percent_as_number: 93.34909843334319, task_max_waiting_in_queue_millis: 0, timed_out: False

1 0

** PROBLEM alert - search.svc.codfw.wmnet/ElasticSearch health check for shards on 9443 is CRITICAL **
by nagios＠icinga1001.wikimedia.org 03 May '19

03 May '19

Notification Type: PROBLEM Service: ElasticSearch health check for shards on 9443 Host: search.svc.codfw.wmnet Address: 10.2.1.30 State: CRITICAL Date/Time: Fri May 3 00:31:52 UTC 2019 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Additional Info: CRITICAL - elasticsearch https://search.svc.codfw.wmnet:9443/_cluster/health error while fetching: HTTPSConnectionPool(host=search.svc.codfw.wmnet, port=9443): Read timed out. (read timeout=4)

1 0

** RECOVERY alert - icinga1001/Mediawiki Cirrussearch update rate - eqiad is OK **
by nagios＠icinga1001.wikimedia.org 02 May '19

02 May '19

Notification Type: RECOVERY Service: Mediawiki Cirrussearch update rate - eqiad Host: icinga1001 Address: 208.80.154.84 State: OK Date/Time: Thu May 2 04:06:47 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: OK: Less than 1.00% under the threshold [80.0]

1 0

** RECOVERY alert - icinga1001/Mediawiki Cirrussearch update rate - codfw is OK **
by nagios＠icinga1001.wikimedia.org 02 May '19

02 May '19

Notification Type: RECOVERY Service: Mediawiki Cirrussearch update rate - codfw Host: icinga1001 Address: 208.80.154.84 State: OK Date/Time: Thu May 2 04:05:19 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: OK: Less than 1.00% under the threshold [80.0]

1 0

** PROBLEM alert - icinga1001/Mediawiki Cirrussearch update rate - eqiad is CRITICAL **
by nagios＠icinga1001.wikimedia.org 02 May '19

02 May '19

Notification Type: PROBLEM Service: Mediawiki Cirrussearch update rate - eqiad Host: icinga1001 Address: 208.80.154.84 State: CRITICAL Date/Time: Thu May 2 03:40:33 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: CRITICAL: 30.00% of data under the critical threshold [50.0]

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

Discovery-alerts May 2019