Notification Type: PROBLEM
Service: WMCS Galera Database
Host: cloudcontrol1003
Address: 208.80.154.23
State: CRITICAL
Date/Time: Wed Feb 23 19:05:48 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting
Acknowledged by :
Additional Info:
Error during connection: Cant connect to MySQL server on 208.80.154.23 (115)
Notification Type: RECOVERY
Service: mysql -galera- process
Host: cloudcontrol1003
Address: 208.80.154.23
State: OK
Date/Time: Wed Feb 23 18:44:07 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting
Acknowledged by :
Additional Info:
PROCS OK: 1 process with command name mariadbd
Notification Type: ACKNOWLEDGEMENT
Service: mysql -galera- process
Host: cloudcontrol1003
Address: 208.80.154.23
State: CRITICAL
Date/Time: Wed Feb 23 18:41:37 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting
Acknowledged by andrew bogott: T302146
Additional Info:
PROCS CRITICAL: 0 processes with command name mariadbd
Notification Type: PROBLEM
Service: mysql -galera- process
Host: cloudcontrol1003
Address: 208.80.154.23
State: CRITICAL
Date/Time: Wed Feb 23 18:39:53 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting
Acknowledged by :
Additional Info:
PROCS CRITICAL: 0 processes with command name mariadbd
Notification Type: PROBLEM
Service: WMCS Galera Database
Host: cloudcontrol1005
Address: 208.80.154.85
State: CRITICAL
Date/Time: Wed Feb 23 18:08:00 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting
Acknowledged by :
Additional Info:
Error during connection: Too many connections
Notification Type: RECOVERY
Service: nova instance creation test
Host: cloudcontrol1003
Address: 208.80.154.23
State: OK
Date/Time: Wed Feb 23 18:02:32 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting
Acknowledged by :
Additional Info:
PROCS OK: 1 process with command name python3, args nova-fullstack
Notification Type: ACKNOWLEDGEMENT
Service: mysql -galera- process
Host: cloudcontrol1004
Address: 208.80.154.132
State: CRITICAL
Date/Time: Wed Feb 23 17:53:03 UTC 2022
Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting
Acknowledged by andrew bogott: this is down on purpose, T302146
Additional Info:
PROCS CRITICAL: 0 processes with command name mariadbd