Notification Type: PROBLEM
Service: WMCS Galera Cluster
Host: cloudcontrol1004
Address: 208.80.154.132
State: CRITICAL
Date/Time: Tue Aug 4 20:03:06 UTC 2020
Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting
Acknowledged by :
Additional Info:
Error during connection: Cant connect to MySQL server on 208.80.154.132 (110 Connection timed out)
Notification Type: PROBLEM
Service: WMCS Galera Database
Host: cloudcontrol1004
Address: 208.80.154.132
State: CRITICAL
Date/Time: Tue Aug 4 20:02:20 UTC 2020
Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting
Acknowledged by :
Additional Info:
Error during connection: Cant connect to MySQL server on 208.80.154.132 (110 Connection timed out)
Notification Type: RECOVERY
Service: Ensure NFS exports are maintained for new instances with NFS
Host: cloudstore1008
Address: 208.80.155.125
State: OK
Date/Time: Tue Aug 4 20:00:16 UTC 2020
Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
Acknowledged by :
Additional Info:
OK - nfs-exportd is active
Notification Type: RECOVERY
Service: Ensure NFS exports are maintained for new instances with NFS
Host: cloudstore1009
Address: 208.80.155.126
State: OK
Date/Time: Tue Aug 4 19:57:58 UTC 2020
Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
Acknowledged by :
Additional Info:
OK - nfs-exportd is active
Notification Type: PROBLEM
Service: Ensure NFS exports are maintained for new instances with NFS
Host: cloudstore1008
Address: 208.80.155.125
State: CRITICAL
Date/Time: Tue Aug 4 19:52:36 UTC 2020
Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
Acknowledged by :
Additional Info:
CRITICAL - Expecting active but unit nfs-exportd is activating
Notification Type: PROBLEM
Service: Check systemd state
Host: cloudcontrol1003
Address: 208.80.154.23
State: CRITICAL
Date/Time: Tue Aug 4 19:52:26 UTC 2020
Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
Acknowledged by :
Additional Info:
CRITICAL - degraded: The system is operational but one or more units failed.
Notification Type: PROBLEM
Service: Ensure NFS exports are maintained for new instances with NFS
Host: cloudstore1009
Address: 208.80.155.126
State: CRITICAL
Date/Time: Tue Aug 4 19:52:12 UTC 2020
Notes URLs: https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
Acknowledged by :
Additional Info:
CRITICAL - Expecting active but unit nfs-exportd is activating
Notification Type: PROBLEM
Service: nova instance creation test
Host: cloudcontrol1003
Address: 208.80.154.23
State: CRITICAL
Date/Time: Tue Aug 4 19:49:22 UTC 2020
Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting
Acknowledged by :
Additional Info:
PROCS CRITICAL: 0 processes with command name python, args nova-fullstack