Discovery-alerts November 2023

discovery-alerts@lists.wikimedia.org

4 participants
205 discussions

Start a nNew thread

[FIRING:1] SystemdUnitFailed search-platform (wdqs1022:9100 systemd-timedated.service ops warning eqiad prometheus)
by sre-observability＠wikimedia.org 30 Nov '23

30 Nov '23

1 0

[FIRING:1] SystemdUnitFailed search-platform (wdqs1022:9100 systemd-timedated.service ops warning eqiad prometheus)
by sre-observability＠wikimedia.org 30 Nov '23

30 Nov '23

1 0

[FIRING:2] RdfStreamingUpdaterHighConsumerUpdateLag wdqs search-platform (jmx_query_service_streaming_updater ops warning eqiad thanos)
by sre-observability＠wikimedia.org 29 Nov '23

29 Nov '23

1 0

[FIRING:1] RdfStreamingUpdaterHighConsumerUpdateLag wdqs-internal search-platform (wdqs1008:9101 jmx_query_service_streaming_updater ops warning eqiad thanos)
by sre-observability＠wikimedia.org 29 Nov '23

29 Nov '23

1 0

[FIRING:2] RdfStreamingUpdaterNotEnoughTaskSlots search-platform (jobmanager k8s-pods rdf-streaming-updater k8s warning codfw prometheus flink-native-kubernetes)
by sre-observability＠wikimedia.org 29 Nov '23

29 Nov '23

1 0

[FIRING:1] RdfStreamingUpdaterNotEnoughTaskSlots search-platform (flink-app-wikidata jobmanager 10_194_175_17 10.194.175.17:9999 k8s-pods rdf-streaming-updater flink-app-wikidata-5c848f599c-wkp84 5c848f599c k8s wikidata wikidata warning codfw prometheus flink-native-kubernetes)
by sre-observability＠wikimedia.org 29 Nov '23

29 Nov '23

1 0

[FIRING:16] RdfStreamingUpdaterHighConsumerUpdateLag wdqs search-platform (jmx_query_service_streaming_updater ops warning codfw thanos)
by sre-observability＠wikimedia.org 29 Nov '23

29 Nov '23

1 0

[FIRING:3] RdfStreamingUpdaterHighConsumerUpdateLag wdqs-internal search-platform (jmx_query_service_streaming_updater ops warning codfw thanos)
by sre-observability＠wikimedia.org 29 Nov '23

29 Nov '23

1 0

RECOVERY Host flink-zk2003 - PING OK - Packet loss = 0%, RTA = 72.94 ms
by nagios＠alert1001.wikimedia.org 29 Nov '23

29 Nov '23

Notification Type: RECOVERY Host: flink-zk2003 State: UP Address: 10.192.48.219 Info: PING OK - Packet loss = 0%, RTA = 72.94 ms Date/Time: Wed Nov 29 17:38:39 UTC 2023 Acknowledged by :

1 0

PROBLEM Host flink-zk2003 - PING CRITICAL - Packet loss = 100%
by nagios＠alert1001.wikimedia.org 29 Nov '23

29 Nov '23

Notification Type: PROBLEM Host: flink-zk2003 State: DOWN Address: 10.192.48.219 Info: PING CRITICAL - Packet loss = 100% Date/Time: Wed Nov 29 17:38:13 UTC 2023 Acknowledged by :

1 0

Jump to page: