Notification Type: PROBLEM
Service: High load average
Host: labstore1004
Address: 10.64.37.19
State: CRITICAL
Date/Time: Wed Aug 29 22:06:31 UTC 2018
Notes URLs: https://grafana.wikimedia.org/dashboard/db/labs-monitoring
Additional Info:
CRITICAL: 66.67% of data above the critical threshold [24.0]
Notification Type: RECOVERY
Service: High load average
Host: labstore1004
Address: 10.64.37.19
State: OK
Date/Time: Wed Aug 29 19:54:13 UTC 2018
Notes URLs: https://grafana.wikimedia.org/dashboard/db/labs-monitoring
Additional Info:
OK: Less than 50.00% above the threshold [16.0]
Notification Type: PROBLEM
Service: High load average
Host: labstore1004
Address: 10.64.37.19
State: CRITICAL
Date/Time: Wed Aug 29 19:49:44 UTC 2018
Notes URLs: https://grafana.wikimedia.org/dashboard/db/labs-monitoring
Additional Info:
CRITICAL: 70.00% of data above the critical threshold [24.0]
Notification Type: ACKNOWLEDGEMENT
Service: Keyholder SSH agent
Host: labpuppetmaster1001
Address: 208.80.154.158
State: CRITICAL
Date/Time: Wed Aug 29 11:47:24 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: Keyholder is not armed. Run keyholder arm to arm it.
Notification Type: PROBLEM
Service: Keyholder SSH agent
Host: labpuppetmaster1001
Address: 208.80.154.158
State: CRITICAL
Date/Time: Wed Aug 29 11:39:23 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: Keyholder is not armed. Run keyholder arm to arm it.
Notification Type: RECOVERY
Service: puppet last run
Host: labvirt1017
Address: 10.64.20.33
State: OK
Date/Time: Wed Aug 29 06:59:27 UTC 2018
Notes URLs:
Additional Info:
OK: Puppet is currently enabled, last run 3 minutes ago with 0 failures
Notification Type: PROBLEM
Service: puppet last run
Host: labvirt1017
Address: 10.64.20.33
State: CRITICAL
Date/Time: Wed Aug 29 06:29:20 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/usr/local/bin/apt2xml]
Notification Type: RECOVERY
Service: puppet last run
Host: labvirt1015
Address: 10.64.20.31
State: OK
Date/Time: Tue Aug 28 16:10:26 UTC 2018
Notes URLs:
Additional Info:
OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
Notification Type: PROBLEM
Service: puppet last run
Host: labvirt1015
Address: 10.64.20.31
State: CRITICAL
Date/Time: Tue Aug 28 16:05:26 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues