October 2023 - Discovery-alerts - lists.wikimedia.org

** PROBLEM alert - graphite1005/CirrusSearch codfw 95th percentile latency is CRITICAL **

by nagios＠alert1001.wikimedia.org

Notification Type: PROBLEM Service: CirrusSearch codfw 95th percentile latency Host: graphite1005 Address: 10.64.16.81 State: CRITICAL Date/Time: Mon Oct 2 22:38:34 UTC 2023 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/d/000000455/elasticsearch-percentiles?orgId=1… Acknowledged by : Additional Info: CRITICAL: 40.00% of data above the critical threshold [1000.0]

7 months, 2 weeks

1
0
0 0

[FIRING:1] RdfStreamingUpdaterHighConsumerUpdateLag wdqs-internal search-platform (wdqs1016:9101 jmx_query_service_streaming_updater ops warning eqiad thanos)

by sre-observability＠wikimedia.org

7 months, 2 weeks

1
0
0 0

[FIRING:5] SystemdUnitFailed search-platform (wdqs1016:9100 ops warning eqiad prometheus)

by sre-observability＠wikimedia.org

7 months, 2 weeks

1
0
0 0

Update on build jenkins-wikidata-query-rdf-maven-release-docker-120

by Release Engineering

The build 120 for wikidata/query/rdf has finished. See https://integration.wikimedia.org/ci/job/wikidata-query-rdf-maven-release-d… for details.

7 months, 2 weeks

1
0
0 0

[FIRING:3] SystemdUnitFailed search-platform (wdqs1016:9100 ops warning eqiad prometheus)

by sre-observability＠wikimedia.org

7 months, 2 weeks

1
0
0 0

[FIRING:1] PuppetConstantChange wdqs-internal search-platform (wdqs1016:9100 node ops warning eqiad prometheus)

by sre-observability＠wikimedia.org

7 months, 2 weeks

1
0
0 0

** RECOVERY alert - graphite1005/CirrusSearch codfw 95th percentile latency is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: CirrusSearch codfw 95th percentile latency Host: graphite1005 Address: 10.64.16.81 State: OK Date/Time: Mon Oct 2 18:10:57 UTC 2023 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/d/000000455/elasticsearch-percentiles?orgId=1… Acknowledged by : Additional Info: OK: Less than 20.00% above the threshold [500.0]

7 months, 2 weeks

1
0
0 0

** PROBLEM alert - graphite1005/CirrusSearch codfw 95th percentile latency is CRITICAL **

by nagios＠alert1001.wikimedia.org

Notification Type: PROBLEM Service: CirrusSearch codfw 95th percentile latency Host: graphite1005 Address: 10.64.16.81 State: CRITICAL Date/Time: Mon Oct 2 18:02:21 UTC 2023 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/d/000000455/elasticsearch-percentiles?orgId=1… Acknowledged by : Additional Info: CRITICAL: 50.00% of data above the critical threshold [1000.0]

7 months, 2 weeks

1
0
0 0

** RECOVERY alert - graphite1005/CirrusSearch codfw 95th percentile latency is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: CirrusSearch codfw 95th percentile latency Host: graphite1005 Address: 10.64.16.81 State: OK Date/Time: Mon Oct 2 17:23:20 UTC 2023 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/d/000000455/elasticsearch-percentiles?orgId=1… Acknowledged by : Additional Info: OK: Less than 20.00% above the threshold [500.0]

7 months, 2 weeks

1
0
0 0

** PROBLEM alert - graphite1005/CirrusSearch codfw 95th percentile latency is CRITICAL **

by nagios＠alert1001.wikimedia.org

Notification Type: PROBLEM Service: CirrusSearch codfw 95th percentile latency Host: graphite1005 Address: 10.64.16.81 State: CRITICAL Date/Time: Mon Oct 2 17:12:12 UTC 2023 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/d/000000455/elasticsearch-percentiles?orgId=1… Acknowledged by : Additional Info: CRITICAL: 40.00% of data above the critical threshold [1000.0]

7 months, 2 weeks

1
0
0 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

Discovery-alerts October 2023