Notification Type: ACKNOWLEDGEMENT
Service: Galera haproxy failover
Host: cloudcontrol1005
Address: 208.80.154.85
State: CRITICAL
Date/Time: Mon Sept 20 22:50:53 UTC 2021
Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy
Acknowledged by andrew bogott: mariadb crashed on cloudcontrol1004. Investigating but may just restart.
Additional Info:
CRITICAL check_failover servers up 34 down 1
Notification Type: ACKNOWLEDGEMENT
Service: mysql -galera- process
Host: cloudcontrol1004
Address: 208.80.154.132
State: CRITICAL
Date/Time: Mon Sept 20 22:50:53 UTC 2021
Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting
Acknowledged by andrew bogott: mariadb crashed on cloudcontrol1004. Investigating but may just restart.
Additional Info:
PROCS CRITICAL: 0 processes with command name mysqld
Notification Type: ACKNOWLEDGEMENT
Service: WMCS Galera Database
Host: cloudcontrol1004
Address: 208.80.154.132
State: CRITICAL
Date/Time: Mon Sept 20 22:50:53 UTC 2021
Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting
Acknowledged by andrew bogott: mariadb crashed on cloudcontrol1004. Investigating but may just restart.
Additional Info:
Error during connection: Cant connect to MySQL server on 208.80.154.132 (115)
Notification Type: ACKNOWLEDGEMENT
Service: WMCS Galera Cluster
Host: cloudcontrol1004
Address: 208.80.154.132
State: CRITICAL
Date/Time: Mon Sept 20 22:50:52 UTC 2021
Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting
Acknowledged by andrew bogott: mariadb crashed on cloudcontrol1004. Investigating but may just restart.
Additional Info:
Error during connection: Cant connect to MySQL server on 208.80.154.132 (115)
Notification Type: ACKNOWLEDGEMENT
Service: Galera haproxy failover
Host: cloudcontrol1004
Address: 208.80.154.132
State: CRITICAL
Date/Time: Mon Sept 20 22:50:52 UTC 2021
Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy
Acknowledged by andrew bogott: mariadb crashed on cloudcontrol1004. Investigating but may just restart.
Additional Info:
CRITICAL check_failover servers up 34 down 1
Notification Type: ACKNOWLEDGEMENT
Service: Galera haproxy failover
Host: cloudcontrol1003
Address: 208.80.154.23
State: CRITICAL
Date/Time: Mon Sept 20 22:50:52 UTC 2021
Notes URLs: https://wikitech.wikimedia.org/wiki/HAProxy
Acknowledged by andrew bogott: mariadb crashed on cloudcontrol1004. Investigating but may just restart.
Additional Info:
CRITICAL check_failover servers up 34 down 1