February 2024 - Discovery-alerts - lists.wikimedia.org

** PROBLEM alert - graphite1005/CirrusSearch more_like codfw 95th percentile latency is CRITICAL **
by nagios＠alert1001.wikimedia.org 06 Feb '24

06 Feb '24

Notification Type: PROBLEM Service: CirrusSearch more_like codfw 95th percentile latency Host: graphite1005 Address: 10.64.16.81 State: CRITICAL Date/Time: Tue Feb 6 06:02:33 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/d/000000455/elasticsearch-percentiles?orgId=1… Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [1500.0]

1 0

** RECOVERY alert - graphite1005/CirrusSearch more_like codfw 95th percentile latency is OK **
by nagios＠alert1001.wikimedia.org 06 Feb '24

06 Feb '24

Notification Type: RECOVERY Service: CirrusSearch more_like codfw 95th percentile latency Host: graphite1005 Address: 10.64.16.81 State: OK Date/Time: Tue Feb 6 04:14:47 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/d/000000455/elasticsearch-percentiles?orgId=1… Acknowledged by : Additional Info: OK: Less than 20.00% above the threshold [1000.0]

1 0

** PROBLEM alert - graphite1005/CirrusSearch more_like codfw 95th percentile latency is CRITICAL **
by nagios＠alert1001.wikimedia.org 06 Feb '24

06 Feb '24

Notification Type: PROBLEM Service: CirrusSearch more_like codfw 95th percentile latency Host: graphite1005 Address: 10.64.16.81 State: CRITICAL Date/Time: Tue Feb 6 04:10:15 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/d/000000455/elasticsearch-percentiles?orgId=1… Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [1500.0]

1 0

[airflow] SLA miss on DAG=image_suggestions_weekly
by airflow-search＠an-airflow1005.eqiad.wmnet 05 Feb '24

05 Feb '24

1 0

** RECOVERY alert - cloudelastic1001/ElasticSearch unassigned shard check - 9400 is OK **
by nagios＠alert1001.wikimedia.org 03 Feb '24

03 Feb '24

Notification Type: RECOVERY Service: ElasticSearch unassigned shard check - 9400 Host: cloudelastic1001 Address: 208.80.154.8 State: OK Date/Time: Sat Feb 3 08:23:19 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - All good

1 0

** RECOVERY alert - cloudelastic1005/ElasticSearch unassigned shard check - 9400 is OK **
by nagios＠alert1001.wikimedia.org 03 Feb '24

03 Feb '24

Notification Type: RECOVERY Service: ElasticSearch unassigned shard check - 9400 Host: cloudelastic1005 Address: 208.80.154.9 State: OK Date/Time: Sat Feb 3 08:23:19 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - All good

1 0

** RECOVERY alert - cloudelastic1004/ElasticSearch unassigned shard check - 9400 is OK **
by nagios＠alert1001.wikimedia.org 03 Feb '24

03 Feb '24

Notification Type: RECOVERY Service: ElasticSearch unassigned shard check - 9400 Host: cloudelastic1004 Address: 208.80.155.107 State: OK Date/Time: Sat Feb 3 08:23:19 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - All good

1 0

** RECOVERY alert - cloudelastic1002/ElasticSearch unassigned shard check - 9400 is OK **
by nagios＠alert1001.wikimedia.org 03 Feb '24

03 Feb '24

Notification Type: RECOVERY Service: ElasticSearch unassigned shard check - 9400 Host: cloudelastic1002 Address: 208.80.154.133 State: OK Date/Time: Sat Feb 3 08:23:19 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - All good

1 0

** RECOVERY alert - cloudelastic1003/ElasticSearch unassigned shard check - 9400 is OK **
by nagios＠alert1001.wikimedia.org 03 Feb '24

03 Feb '24

Notification Type: RECOVERY Service: ElasticSearch unassigned shard check - 9400 Host: cloudelastic1003 Address: 208.80.154.83 State: OK Date/Time: Sat Feb 3 08:23:19 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - All good

1 0

** RECOVERY alert - cloudelastic1007/ElasticSearch unassigned shard check - 9400 is OK **
by nagios＠alert1001.wikimedia.org 03 Feb '24

03 Feb '24

Notification Type: RECOVERY Service: ElasticSearch unassigned shard check - 9400 Host: cloudelastic1007 Address: 208.80.154.11 State: OK Date/Time: Sat Feb 3 08:23:19 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Administration Acknowledged by : Additional Info: OK - All good

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

Discovery-alerts February 2024