April 2019 - Discovery-alerts - lists.wikimedia.org

** RECOVERY alert - icinga1001/Mediawiki Cirrussearch update lag - codfw is OK **
by nagios＠icinga1001.wikimedia.org 17 Apr '19

17 Apr '19

Notification Type: RECOVERY Service: Mediawiki Cirrussearch update lag - codfw Host: icinga1001 Address: 208.80.154.84 State: OK Date/Time: Wed Apr 17 21:35:05 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: OK: Less than 1.00% under the threshold [80.0]

1 0

** PROBLEM alert - icinga1001/Mediawiki Cirrussearch update lag - codfw is CRITICAL **
by nagios＠icinga1001.wikimedia.org 17 Apr '19

17 Apr '19

Notification Type: PROBLEM Service: Mediawiki Cirrussearch update lag - codfw Host: icinga1001 Address: 208.80.154.84 State: CRITICAL Date/Time: Wed Apr 17 21:13:48 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: CRITICAL: 20.00% of data under the critical threshold [50.0]

1 0

** PROBLEM alert - icinga1001/Mediawiki Cirrussearch update lag - eqiad is CRITICAL **
by nagios＠icinga1001.wikimedia.org 17 Apr '19

17 Apr '19

Notification Type: PROBLEM Service: Mediawiki Cirrussearch update lag - eqiad Host: icinga1001 Address: 208.80.154.84 State: CRITICAL Date/Time: Wed Apr 17 21:13:36 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: CRITICAL: 20.00% of data under the critical threshold [50.0]

1 0

** RECOVERY alert - icinga1001/Mediawiki Cirrussearch update lag - eqiad is OK **
by nagios＠icinga1001.wikimedia.org 17 Apr '19

17 Apr '19

Notification Type: RECOVERY Service: Mediawiki Cirrussearch update lag - eqiad Host: icinga1001 Address: 208.80.154.84 State: OK Date/Time: Wed Apr 17 11:57:34 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: OK: Less than 1.00% under the threshold [80.0]

1 0

** RECOVERY alert - icinga1001/Mediawiki Cirrussearch update lag - codfw is OK **
by nagios＠icinga1001.wikimedia.org 17 Apr '19

17 Apr '19

Notification Type: RECOVERY Service: Mediawiki Cirrussearch update lag - codfw Host: icinga1001 Address: 208.80.154.84 State: OK Date/Time: Wed Apr 17 11:56:58 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: OK: Less than 1.00% under the threshold [80.0]

1 0

** PROBLEM alert - icinga1001/Mediawiki Cirrussearch update lag - codfw is CRITICAL **
by nagios＠icinga1001.wikimedia.org 17 Apr '19

17 Apr '19

Notification Type: PROBLEM Service: Mediawiki Cirrussearch update lag - codfw Host: icinga1001 Address: 208.80.154.84 State: CRITICAL Date/Time: Wed Apr 17 11:29:42 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: CRITICAL: 20.00% of data under the critical threshold [50.0]

1 0

** PROBLEM alert - icinga1001/Mediawiki Cirrussearch update lag - eqiad is CRITICAL **
by nagios＠icinga1001.wikimedia.org 17 Apr '19

17 Apr '19

Notification Type: PROBLEM Service: Mediawiki Cirrussearch update lag - eqiad Host: icinga1001 Address: 208.80.154.84 State: CRITICAL Date/Time: Wed Apr 17 11:29:00 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: CRITICAL: 10.00% of data under the critical threshold [50.0]

1 0

** RECOVERY alert - icinga1001/Mediawiki Cirrussearch update lag - eqiad is OK **
by nagios＠icinga1001.wikimedia.org 14 Apr '19

14 Apr '19

Notification Type: RECOVERY Service: Mediawiki Cirrussearch update lag - eqiad Host: icinga1001 Address: 208.80.154.84 State: OK Date/Time: Sun Apr 14 14:31:10 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: OK: Less than 1.00% under the threshold [80.0]

1 0

** RECOVERY alert - icinga1001/Mediawiki Cirrussearch update lag - codfw is OK **
by nagios＠icinga1001.wikimedia.org 14 Apr '19

14 Apr '19

Notification Type: RECOVERY Service: Mediawiki Cirrussearch update lag - codfw Host: icinga1001 Address: 208.80.154.84 State: OK Date/Time: Sun Apr 14 14:30:44 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: OK: Less than 1.00% under the threshold [80.0]

1 0

** PROBLEM alert - icinga1001/Mediawiki Cirrussearch update lag - eqiad is CRITICAL **
by nagios＠icinga1001.wikimedia.org 14 Apr '19

14 Apr '19

Notification Type: PROBLEM Service: Mediawiki Cirrussearch update lag - eqiad Host: icinga1001 Address: 208.80.154.84 State: CRITICAL Date/Time: Sun Apr 14 14:11:48 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: CRITICAL: 30.00% of data under the critical threshold [50.0]

1 0

** PROBLEM alert - icinga1001/Mediawiki Cirrussearch update lag - codfw is CRITICAL **
by nagios＠icinga1001.wikimedia.org 14 Apr '19

14 Apr '19

Notification Type: PROBLEM Service: Mediawiki Cirrussearch update lag - codfw Host: icinga1001 Address: 208.80.154.84 State: CRITICAL Date/Time: Sun Apr 14 14:11:24 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: CRITICAL: 20.00% of data under the critical threshold [50.0]

1 0

** RECOVERY alert - graphite1004/CirrusSearch eqiad 95th percentile latency is OK **
by nagios＠icinga1001.wikimedia.org 14 Apr '19

14 Apr '19

Notification Type: RECOVERY Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: OK Date/Time: Sun Apr 14 05:41:37 UTC 2019 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Additional Info: OK: Less than 20.00% above the threshold [500.0]

1 0

** PROBLEM alert - graphite1004/CirrusSearch eqiad 95th percentile latency is CRITICAL **
by nagios＠icinga1001.wikimedia.org 14 Apr '19

14 Apr '19

Notification Type: PROBLEM Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: CRITICAL Date/Time: Sun Apr 14 04:07:51 UTC 2019 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Additional Info: CRITICAL: 30.00% of data above the critical threshold [1000.0]

1 0

** RECOVERY alert - graphite1004/CirrusSearch eqiad 95th percentile latency is OK **
by nagios＠icinga1001.wikimedia.org 14 Apr '19

14 Apr '19

Notification Type: RECOVERY Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: OK Date/Time: Sun Apr 14 03:44:35 UTC 2019 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Additional Info: OK: Less than 20.00% above the threshold [500.0]

1 0

** PROBLEM alert - graphite1004/CirrusSearch eqiad 95th percentile latency is CRITICAL **
by nagios＠icinga1001.wikimedia.org 14 Apr '19

14 Apr '19

Notification Type: PROBLEM Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: CRITICAL Date/Time: Sun Apr 14 03:07:59 UTC 2019 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Additional Info: CRITICAL: 20.00% of data above the critical threshold [1000.0]

1 0

** PROBLEM alert - graphite1004/CirrusSearch eqiad 95th percentile latency is CRITICAL **
by nagios＠icinga1001.wikimedia.org 14 Apr '19

14 Apr '19

Notification Type: PROBLEM Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: CRITICAL Date/Time: Sun Apr 14 02:49:47 UTC 2019 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Additional Info: CRITICAL: 20.00% of data above the critical threshold [1000.0]

1 0

** RECOVERY alert - graphite1004/CirrusSearch eqiad 95th percentile latency is OK **
by nagios＠icinga1001.wikimedia.org 14 Apr '19

14 Apr '19

Notification Type: RECOVERY Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: OK Date/Time: Sun Apr 14 02:44:35 UTC 2019 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Additional Info: OK: Less than 20.00% above the threshold [500.0]

1 0

** PROBLEM alert - graphite1004/CirrusSearch eqiad 95th percentile latency is CRITICAL **
by nagios＠icinga1001.wikimedia.org 14 Apr '19

14 Apr '19

Notification Type: PROBLEM Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: CRITICAL Date/Time: Sun Apr 14 02:01:33 UTC 2019 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Additional Info: CRITICAL: 30.00% of data above the critical threshold [1000.0]

1 0

** RECOVERY alert - graphite1004/CirrusSearch eqiad 95th percentile latency is OK **
by nagios＠icinga1001.wikimedia.org 13 Apr '19

13 Apr '19

Notification Type: RECOVERY Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: OK Date/Time: Sat Apr 13 16:33:14 UTC 2019 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Additional Info: OK: Less than 20.00% above the threshold [500.0]

1 0

** PROBLEM alert - graphite1004/CirrusSearch eqiad 95th percentile latency is CRITICAL **
by nagios＠icinga1001.wikimedia.org 13 Apr '19

13 Apr '19

Notification Type: PROBLEM Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: CRITICAL Date/Time: Sat Apr 13 14:05:14 UTC 2019 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Additional Info: CRITICAL: 30.00% of data above the critical threshold [1000.0]

1 0

** PROBLEM alert - graphite1004/CirrusSearch eqiad 95th percentile latency is CRITICAL **
by nagios＠icinga1001.wikimedia.org 13 Apr '19

13 Apr '19

Notification Type: PROBLEM Service: CirrusSearch eqiad 95th percentile latency Host: graphite1004 Address: 10.64.16.149 State: CRITICAL Date/Time: Sat Apr 13 13:33:58 UTC 2019 Notes URLs: https://grafana.wikimedia.org/dashboard/db/elasticsearch-percentiles?panelI… Additional Info: CRITICAL: 30.00% of data above the critical threshold [1000.0]

1 0

** RECOVERY alert - icinga1001/Mediawiki Cirrussearch update lag - eqiad is OK **
by nagios＠icinga1001.wikimedia.org 12 Apr '19

12 Apr '19

Notification Type: RECOVERY Service: Mediawiki Cirrussearch update lag - eqiad Host: icinga1001 Address: 208.80.154.84 State: OK Date/Time: Fri Apr 12 14:15:22 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: OK: Less than 1.00% under the threshold [80.0]

1 0

** RECOVERY alert - icinga1001/Mediawiki Cirrussearch update lag - codfw is OK **
by nagios＠icinga1001.wikimedia.org 12 Apr '19

12 Apr '19

Notification Type: RECOVERY Service: Mediawiki Cirrussearch update lag - codfw Host: icinga1001 Address: 208.80.154.84 State: OK Date/Time: Fri Apr 12 14:14:52 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: OK: Less than 1.00% under the threshold [80.0]

1 0

** PROBLEM alert - icinga1001/Mediawiki Cirrussearch update lag - eqiad is CRITICAL **
by nagios＠icinga1001.wikimedia.org 12 Apr '19

12 Apr '19

Notification Type: PROBLEM Service: Mediawiki Cirrussearch update lag - eqiad Host: icinga1001 Address: 208.80.154.84 State: CRITICAL Date/Time: Fri Apr 12 13:53:46 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: CRITICAL: 10.00% of data under the critical threshold [50.0]

1 0

** PROBLEM alert - icinga1001/Mediawiki Cirrussearch update lag - codfw is CRITICAL **
by nagios＠icinga1001.wikimedia.org 12 Apr '19

12 Apr '19

Notification Type: PROBLEM Service: Mediawiki Cirrussearch update lag - codfw Host: icinga1001 Address: 208.80.154.84 State: CRITICAL Date/Time: Fri Apr 12 13:53:22 UTC 2019 Notes URLs: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Additional Info: CRITICAL: 10.00% of data under the critical threshold [50.0]

1 0

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

Discovery-alerts April 2019