April 2021 - Cloud-admin-feed - lists.wikimedia.org

** PROBLEM alert - checker.tools.wmflabs.org/toolschecker: All k8s etcd nodes are healthy is CRITICAL **
by nagios＠alert1001.wikimedia.org 29 Apr '21

29 Apr '21

Notification Type: PROBLEM Service: toolschecker: All k8s etcd nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Thu Apr 29 18:19:26 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP CRITICAL: HTTP/1.1 503 SERVICE UNAVAILABLE - string OK not found on http://checker.tools.wmflabs.org:80/etcd/k8s - 510 bytes in 0.013 second response time

1 0

** RECOVERY alert - cloudmetrics1002/carbon-cache@g service is OK **
by nagios＠alert1001.wikimedia.org 29 Apr '21

29 Apr '21

Notification Type: RECOVERY Service: carbon-cache@g service Host: cloudmetrics1002 Address: 10.64.4.15 State: OK Date/Time: Thu Apr 29 15:17:29 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state Acknowledged by : Additional Info: OK - carbon-cache@g is active

1 0

** RECOVERY alert - cloudmetrics1002/carbon-frontend-relay service is OK **
by nagios＠alert1001.wikimedia.org 29 Apr '21

29 Apr '21

Notification Type: RECOVERY Service: carbon-frontend-relay service Host: cloudmetrics1002 Address: 10.64.4.15 State: OK Date/Time: Thu Apr 29 15:17:29 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state Acknowledged by : Additional Info: OK - carbon-frontend-relay is active

1 0

** RECOVERY alert - cloudmetrics1002/carbon-cache@a service is OK **
by nagios＠alert1001.wikimedia.org 29 Apr '21

29 Apr '21

Notification Type: RECOVERY Service: carbon-cache@a service Host: cloudmetrics1002 Address: 10.64.4.15 State: OK Date/Time: Thu Apr 29 15:17:15 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state Acknowledged by : Additional Info: OK - carbon-cache@a is active

1 0

** RECOVERY alert - cloudmetrics1002/carbon-cache@h service is OK **
by nagios＠alert1001.wikimedia.org 29 Apr '21

29 Apr '21

Notification Type: RECOVERY Service: carbon-cache@h service Host: cloudmetrics1002 Address: 10.64.4.15 State: OK Date/Time: Thu Apr 29 15:16:53 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state Acknowledged by : Additional Info: OK - carbon-cache@h is active

1 0

** RECOVERY alert - cloudmetrics1002/grafana-labs.wikimedia.org is OK **
by nagios＠alert1001.wikimedia.org 29 Apr '21

29 Apr '21

Notification Type: RECOVERY Service: grafana-labs.wikimedia.org Host: cloudmetrics1002 Address: 10.64.4.15 State: OK Date/Time: Thu Apr 29 15:15:35 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Grafana.wikimedia.org Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 200 OK - 39408 bytes in 0.008 second response time

1 0

** RECOVERY alert - cloudmetrics1002/graphite-labs.wikimedia.org api is OK **
by nagios＠alert1001.wikimedia.org 29 Apr '21

29 Apr '21

Notification Type: RECOVERY Service: graphite-labs.wikimedia.org api Host: cloudmetrics1002 Address: 10.64.4.15 State: OK Date/Time: Thu Apr 29 15:15:13 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Graphite%23Operations_troubleshooting Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 200 OK - 311 bytes in 0.014 second response time

1 0

** PROBLEM alert - cloudmetrics1002/carbon-cache@g service is CRITICAL **
by nagios＠alert1001.wikimedia.org 29 Apr '21

29 Apr '21

Notification Type: PROBLEM Service: carbon-cache@g service Host: cloudmetrics1002 Address: 10.64.4.15 State: CRITICAL Date/Time: Thu Apr 29 15:14:59 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state Acknowledged by : Additional Info: CRITICAL - Expecting active but unit carbon-cache@g is inactive

1 0

** PROBLEM alert - cloudmetrics1002/carbon-frontend-relay service is CRITICAL **
by nagios＠alert1001.wikimedia.org 29 Apr '21

29 Apr '21

Notification Type: PROBLEM Service: carbon-frontend-relay service Host: cloudmetrics1002 Address: 10.64.4.15 State: CRITICAL Date/Time: Thu Apr 29 15:14:59 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state Acknowledged by : Additional Info: CRITICAL - Expecting active but unit carbon-frontend-relay is inactive

1 0

** PROBLEM alert - cloudmetrics1002/carbon-cache@a service is CRITICAL **
by nagios＠alert1001.wikimedia.org 29 Apr '21

29 Apr '21

Notification Type: PROBLEM Service: carbon-cache@a service Host: cloudmetrics1002 Address: 10.64.4.15 State: CRITICAL Date/Time: Thu Apr 29 15:14:45 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state Acknowledged by : Additional Info: CRITICAL - Expecting active but unit carbon-cache@a is inactive

1 0

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed April 2021