August 2018 - Discovery-alerts - lists.wikimedia.org

Fatal Error - Oozie Job discovery-transfer_to_es-discovery.popularity_score-2018, 8, 13->cirrussearch-wf
by oozie＠analytics1003.eqiad.wmnet 16 Aug '18

16 Aug '18

Error details: - Job id: UNSET - Failing action: transfer - Error code: UNSET - Error message: UNSET - Hue link: https://hue.wikimedia.org/oozie/list_oozie_workflows Please have a look and take necessary action ! Thanks :) -- Oozie

1 0

Fatal Error - Oozie Job discovery-transfer_to_es-discovery.popularity_score-2018, 8, 13->cirrussearch-wf
by oozie＠analytics1003.eqiad.wmnet 16 Aug '18

16 Aug '18

Error details: - Job id: UNSET - Failing action: transfer - Error code: UNSET - Error message: UNSET - Hue link: https://hue.wikimedia.org/oozie/list_oozie_workflows Please have a look and take necessary action ! Thanks :) -- Oozie

1 0

Fatal Error - Oozie Job discovery-transfer_to_es-discovery.popularity_score-2018, 8, 13->cirrussearch-wf
by oozie＠analytics1003.eqiad.wmnet 16 Aug '18

16 Aug '18

Error details: - Job id: UNSET - Failing action: transfer - Error code: UNSET - Error message: UNSET - Hue link: https://hue.wikimedia.org/oozie/list_oozie_workflows Please have a look and take necessary action ! Thanks :) -- Oozie

1 0

Fatal Error - Oozie Job discovery-transfer_to_es-discovery.popularity_score-2018, 8, 13->cirrussearch-wf
by oozie＠analytics1003.eqiad.wmnet 16 Aug '18

16 Aug '18

Error details: - Job id: UNSET - Failing action: transfer - Error code: UNSET - Error message: UNSET - Hue link: https://hue.wikimedia.org/oozie/list_oozie_workflows Please have a look and take necessary action ! Thanks :) -- Oozie

1 0

Fatal Error - Oozie Job discovery-transfer_to_es-discovery.popularity_score-2018, 8, 13->cirrussearch-wf
by oozie＠analytics1003.eqiad.wmnet 16 Aug '18

16 Aug '18

Error details: - Job id: UNSET - Failing action: transfer - Error code: UNSET - Error message: UNSET - Hue link: https://hue.wikimedia.org/oozie/list_oozie_workflows Please have a look and take necessary action ! Thanks :) -- Oozie

1 0

Fatal Error - Oozie Job discovery-transfer_to_es-discovery.popularity_score-2018, 8, 13->cirrussearch-wf
by oozie＠analytics1003.eqiad.wmnet 16 Aug '18

16 Aug '18

Error details: - Job id: UNSET - Failing action: transfer - Error code: UNSET - Error message: UNSET - Hue link: https://hue.wikimedia.org/oozie/list_oozie_workflows Please have a look and take necessary action ! Thanks :) -- Oozie

1 0

** RECOVERY alert - graphite1001/CirrusSearch eqiad 95th percentile latency is OK **
by icinga＠einsteinium.wikimedia.org 15 Aug '18

15 Aug '18

Notification Type: RECOVERY Service: CirrusSearch eqiad 95th percentile latency Host: graphite1001 Address: 10.64.32.155 State: OK Date/Time: Wed Aug 15 19:47:39 UTC 2018 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Additional Info: OK: Less than 20.00% above the threshold [500.0]

1 0

** PROBLEM alert - graphite1001/CirrusSearch eqiad 95th percentile latency is CRITICAL **
by icinga＠einsteinium.wikimedia.org 15 Aug '18

15 Aug '18

Notification Type: PROBLEM Service: CirrusSearch eqiad 95th percentile latency Host: graphite1001 Address: 10.64.32.155 State: CRITICAL Date/Time: Wed Aug 15 19:39:38 UTC 2018 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Additional Info: CRITICAL: 20.00% of data above the critical threshold [1000.0]

1 0

** RECOVERY alert - graphite1001/Number of backend failures per minute from CirrusSearch is OK **
by icinga＠einsteinium.wikimedia.org 14 Aug '18

14 Aug '18

Notification Type: RECOVERY Service: Number of backend failures per minute from CirrusSearch Host: graphite1001 Address: 10.64.32.155 State: OK Date/Time: Tue Aug 14 17:12:10 UTC 2018 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?orgId=… Additional Info: OK: Less than 20.00% above the threshold [300.0]

1 0

** PROBLEM alert - graphite1001/Number of backend failures per minute from CirrusSearch is CRITICAL **
by icinga＠einsteinium.wikimedia.org 14 Aug '18

14 Aug '18

Notification Type: PROBLEM Service: Number of backend failures per minute from CirrusSearch Host: graphite1001 Address: 10.64.32.155 State: CRITICAL Date/Time: Tue Aug 14 17:05:50 UTC 2018 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?orgId=… Additional Info: CRITICAL: 20.00% of data above the critical threshold [600.0]

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

Discovery-alerts August 2018