- Discovery-alerts - lists.wikimedia.org

** PROBLEM alert - graphite1001/CirrusSearch eqiad 95th percentile latency is CRITICAL **
by icinga＠einsteinium.wikimedia.org 14 Aug '18

14 Aug '18

Notification Type: PROBLEM Service: CirrusSearch eqiad 95th percentile latency Host: graphite1001 Address: 10.64.32.155 State: CRITICAL Date/Time: Tue Aug 14 11:40:59 UTC 2018 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Additional Info: CRITICAL: 20.00% of data above the critical threshold [1000.0]

1 0

** RECOVERY alert - graphite1001/CirrusSearch eqiad 95th percentile latency is OK **
by icinga＠einsteinium.wikimedia.org 14 Aug '18

14 Aug '18

Notification Type: RECOVERY Service: CirrusSearch eqiad 95th percentile latency Host: graphite1001 Address: 10.64.32.155 State: OK Date/Time: Tue Aug 14 09:58:04 UTC 2018 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Additional Info: OK: Less than 20.00% above the threshold [500.0]

1 0

** PROBLEM alert - graphite1001/CirrusSearch eqiad 95th percentile latency is CRITICAL **
by icinga＠einsteinium.wikimedia.org 14 Aug '18

14 Aug '18

Notification Type: PROBLEM Service: CirrusSearch eqiad 95th percentile latency Host: graphite1001 Address: 10.64.32.155 State: CRITICAL Date/Time: Tue Aug 14 09:33:23 UTC 2018 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Additional Info: CRITICAL: 20.00% of data above the critical threshold [1000.0]

1 0

** RECOVERY alert - graphite1001/CirrusSearch eqiad 95th percentile latency is OK **
by icinga＠einsteinium.wikimedia.org 13 Aug '18

13 Aug '18

Notification Type: RECOVERY Service: CirrusSearch eqiad 95th percentile latency Host: graphite1001 Address: 10.64.32.155 State: OK Date/Time: Mon Aug 13 18:29:53 UTC 2018 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Additional Info: OK: Less than 20.00% above the threshold [500.0]

1 0

** ACKNOWLEDGEMENT alert - graphite1001/CirrusSearch eqiad 95th percentile latency is CRITICAL **
by icinga＠einsteinium.wikimedia.org 13 Aug '18

13 Aug '18

Notification Type: ACKNOWLEDGEMENT Service: CirrusSearch eqiad 95th percentile latency Host: graphite1001 Address: 10.64.32.155 State: CRITICAL Date/Time: Mon Aug 13 17:20:02 UTC 2018 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Additional Info: CRITICAL: 100.00% of data above the critical threshold [1000.0]

1 0

** PROBLEM alert - graphite1001/CirrusSearch eqiad 95th percentile latency is CRITICAL **
by icinga＠einsteinium.wikimedia.org 13 Aug '18

13 Aug '18

Notification Type: PROBLEM Service: CirrusSearch eqiad 95th percentile latency Host: graphite1001 Address: 10.64.32.155 State: CRITICAL Date/Time: Mon Aug 13 16:52:43 UTC 2018 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Additional Info: CRITICAL: 20.00% of data above the critical threshold [1000.0]

1 0

** RECOVERY alert - graphite1001/Number of backend failures per minute from CirrusSearch is OK **
by icinga＠einsteinium.wikimedia.org 13 Aug '18

13 Aug '18

Notification Type: RECOVERY Service: Number of backend failures per minute from CirrusSearch Host: graphite1001 Address: 10.64.32.155 State: OK Date/Time: Mon Aug 13 13:42:29 UTC 2018 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?orgId=… Additional Info: OK: Less than 20.00% above the threshold [300.0]

1 0

** PROBLEM alert - graphite1001/Number of backend failures per minute from CirrusSearch is CRITICAL **
by icinga＠einsteinium.wikimedia.org 13 Aug '18

13 Aug '18

Notification Type: PROBLEM Service: Number of backend failures per minute from CirrusSearch Host: graphite1001 Address: 10.64.32.155 State: CRITICAL Date/Time: Mon Aug 13 13:36:28 UTC 2018 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?orgId=… Additional Info: CRITICAL: 20.00% of data above the critical threshold [600.0]

1 0

Fatal Error - Oozie Job discovery-transfer_to_es-discovery.popularity_score-2018, 8, 6->cirrussearch-wf
by oozie＠analytics1003.eqiad.wmnet 09 Aug '18

09 Aug '18

Error details: - Job id: UNSET - Failing action: transfer - Error code: UNSET - Error message: UNSET - Hue link: https://hue.wikimedia.org/oozie/list_oozie_workflows Please have a look and take necessary action ! Thanks :) -- Oozie

1 0

Fatal Error - Oozie Job discovery-transfer_to_es-discovery.popularity_score-2018, 8, 6->cirrussearch-wf
by oozie＠analytics1003.eqiad.wmnet 09 Aug '18

09 Aug '18

Error details: - Job id: UNSET - Failing action: transfer - Error code: UNSET - Error message: UNSET - Hue link: https://hue.wikimedia.org/oozie/list_oozie_workflows Please have a look and take necessary action ! Thanks :) -- Oozie

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

Discovery-alerts