August 2022 - Discovery-alerts - lists.wikimedia.org

** ACKNOWLEDGEMENT alert - search.svc.eqiad.wmnet/ElasticSearch numbers of masters eligible - 9243 is CRITICAL **
by nagios＠alert1001.wikimedia.org 15 Aug '22

15 Aug '22

Notification Type: ACKNOWLEDGEMENT Service: ElasticSearch numbers of masters eligible - 9243 Host: search.svc.eqiad.wmnet Address: 10.2.2.30 State: CRITICAL Date/Time: Mon Aug 15 18:47:57 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Expected_eligible_masters_chec… Acknowledged by Brian_King: cluster reimage ongoing, this is expected Additional Info: CRITICAL - Found 2 eligible masters.

1 0

** PROBLEM alert - search.svc.eqiad.wmnet/ElasticSearch numbers of masters eligible - 9243 is CRITICAL **
by nagios＠alert1001.wikimedia.org 15 Aug '22

15 Aug '22

Notification Type: PROBLEM Service: ElasticSearch numbers of masters eligible - 9243 Host: search.svc.eqiad.wmnet Address: 10.2.2.30 State: CRITICAL Date/Time: Mon Aug 15 18:44:52 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Expected_eligible_masters_chec… Acknowledged by : Additional Info: CRITICAL - Found 2 eligible masters.

1 0

** RECOVERY alert - graphite1004/Number of backend failures per minute from CirrusSearch is OK **
by nagios＠alert1001.wikimedia.org 15 Aug '22

15 Aug '22

Notification Type: RECOVERY Service: Number of backend failures per minute from CirrusSearch Host: graphite1004 Address: 10.64.16.149 State: OK Date/Time: Mon Aug 15 17:15:55 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/d/000000455/elasticsearch-percentiles?orgId=1… Acknowledged by : Additional Info: OK: Less than 20.00% above the threshold [300.0]

1 0

[airflow] SLA miss on DAG=image_suggestions_weekly
by noreply＠wikimedia.org 15 Aug '22

15 Aug '22

1 0

** RECOVERY alert - search.svc.eqiad.wmnet/ElasticSearch numbers of masters eligible - 9443 is OK **
by nagios＠alert1001.wikimedia.org 15 Aug '22

15 Aug '22

Notification Type: RECOVERY Service: ElasticSearch numbers of masters eligible - 9443 Host: search.svc.eqiad.wmnet Address: 10.2.2.30 State: OK Date/Time: Mon Aug 15 14:56:25 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Expected_eligible_masters_chec… Acknowledged by : Additional Info: OK - All good

1 0

** PROBLEM alert - search.svc.eqiad.wmnet/ElasticSearch numbers of masters eligible - 9443 is CRITICAL **
by nagios＠alert1001.wikimedia.org 15 Aug '22

15 Aug '22

Notification Type: PROBLEM Service: ElasticSearch numbers of masters eligible - 9443 Host: search.svc.eqiad.wmnet Address: 10.2.2.30 State: CRITICAL Date/Time: Mon Aug 15 14:23:36 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Expected_eligible_masters_chec… Acknowledged by : Additional Info: CRITICAL - Found 2 eligible masters.

1 0

** PROBLEM alert - graphite1004/Number of backend failures per minute from CirrusSearch is CRITICAL **
by nagios＠alert1001.wikimedia.org 15 Aug '22

15 Aug '22

Notification Type: PROBLEM Service: Number of backend failures per minute from CirrusSearch Host: graphite1004 Address: 10.64.16.149 State: CRITICAL Date/Time: Mon Aug 15 13:16:29 UTC 2022 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/d/000000455/elasticsearch-percentiles?orgId=1… Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [600.0]

1 0

Airflow alert: <TaskInstance: drop_old_data_daily.drop_subgraph_mapping_and_metrics_partitions 2022-08-14T00:00:00+00:00 [failed]>
by noreply＠wikimedia.org 15 Aug '22

15 Aug '22

1 0

Airflow alert: <TaskInstance: drop_old_data_daily.drop_subgraph_mapping_and_metrics_partitions 2022-08-13T00:00:00+00:00 [failed]>
by noreply＠wikimedia.org 14 Aug '22

14 Aug '22

1 0

Airflow alert: <TaskInstance: drop_old_data_daily.drop_subgraph_mapping_and_metrics_partitions 2022-08-12T00:00:00+00:00 [failed]>
by noreply＠wikimedia.org 13 Aug '22

13 Aug '22

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

Discovery-alerts August 2022